150 likes | 282 Views
Evaluation Tools and Models Northern Plains CCC Program. Comprehensive Cancer Control 2008 Annual Grantee Meetings May 14th, 2008 Atlanta, GA. Inputs. Outputs. Outcomes - Impact. Activities. Participation. Short Term. Medium Term. Long Term.
E N D
Evaluation Tools and ModelsNorthern Plains CCC Program Comprehensive Cancer Control2008 Annual Grantee MeetingsMay 14th, 2008Atlanta, GA
Inputs Outputs Outcomes - Impact Activities Participation Short Term Medium Term Long Term Northern Plains Comprehensive Cancer Control Program Logic Model 1-3 years 4-6 years 7-10 years Conference calls and meetings with Coalition and partners Tribal Leadership Increased knowledge and awareness of cancer prevention and control Change in risk factors for cancer Funding – CDC and other resources Health Professionals Increase in cancer screening accessibility Decreased Cancer Incidence Rates Cancer Organizations Engage tribal community for support Increase in cancer screening rates Increased skills and capacity to address cancer Cancer Survivors Staff: ~2 full time Decreased Cancer Mortality Rates Increased cancer treatment resources and support Educate community Tribal Health Workers Increased support from key partners Coalition and Partners Create Strategic Plan Media Increase in treatment follow-up Increased numbers of cancer activities in tribal communities Increase in Quality of Life for Cancer Patients State Cancer Programs Improve cancer data Increase in cancer survivor and caregiver support systems Current data and research Cancer Researchers Implement cancer control activities/interventions Indian Health Service employees Improved cultural sensitivity/competency Improved data and surveillance
Strategies • Tracking Data of Coalition and Partnerships (meeting participation, agendas, rosters, etc.) • Partnership Satisfaction and Needs Assessments • Pre and Post Assessments • Cancer Burden and Risk Factor Surveillance • Evaluate absolutely every activity or intervention… • somehow….if we can…
Tools • Audience Response System (ARS) • Online Evaluation Database
Sample Question:What do you like most about this meeting? • Presentations from my peers and colleagues • Poster Session • Free candy and pens • Doing the chicken dance • I don’t know/I’m not sure
How we are using ARS? • Short-term Outcome: Increased knowledge and awareness of cancer prevention and control • Cancer 101 Workshops • Education Conference • Community Colorectal Cancer Workshop • Family Caregiver Workshop
ARS Advantages • Knowledge, Attitude, Belief, Satisfaction outcomes from workshops, meetings, etc. • Efficient data collection, analysis, reporting • Better response rate than paper surveys • Mostly well-received in communities • Can help facilitate group processes
ARS Disadvantages • Cost….? • Technology • Portability (ARS unit and staff) • Community Grant Example • Does not measure knowledge retention or outcome in behavior
Online Evaluation Database • Password protected system • Upload ARS, tracking, evaluation data • Automatically generate reports and summarize data • Tabs for different inputs: Committees, Partnerships, Products, Dissemination, etc.
Online Evaluation Database Advantages • Provides external consultants/partners access • Easier to generate reports • Uniform measures and comparison • Partners information/data? • ……at least we hope……
Online Evaluation DatabaseDisadvantages • Technology • You only get what you put in… • Cancer Burden Data • Time and resources to upload data and maintain site • Appropriate data-sharing • What will we miss?
Evaluation Plans • Update and Revise Evaluation Plan • Continue to improve use of ARS • Tailor and begin using Online Database • Northern Plains Cancer Data Improvement Initiative