220 likes | 382 Views
Questions. What are the issues associated with evaluating PA that you are interested in?What types of programs are you involved in? What type of change are you trying to make?At what level.. program, PCP?. Purpose of this session. Identify some common issues/problems associated with evaluation
E N D
1. Evaluating Physical Activity Kellie Horton
Kinect Australia (VICFIT)
2. Questions… What are the issues associated with evaluating PA that you are interested in?
What types of programs are you involved in?
What type of change are you trying to make?
At what level.. program, PCP?
3. Purpose of this session Identify some common issues/problems associated with evaluation and evaluating PA
Discuss the variation in approaches to evaluating PA
Highlight some of the resources available to you for evaluating PA
Examine how the planning tool can assist in evaluating PA
4. Evaluation…the considerations Why evaluate?
To gain insight
To make improvements
To assess effects
What level of evaluation?
Program
Agency/Organisation
Catchment
5. More considerations… What type of evaluation?
Process
Impact
Outcome
Key issues:
What do I/ we want to know?
How are we going to find it out?
How are we going to make others aware of our learnings?
6. Examples of outcomes of interest for physical activity promotion
Healthy
(active)
Lifestyles Mortality,
Morbidity &
Quality of life
Supportive
Environments
(for PA)
(Bauman, 2003)
7. PA promotion outcomes Capacity Building:
Community Workforce Healthy (active)
Interest & Development Lifestyles
Awareness
Capacity Building:
Healthy P’ships
Healthy & Settings Supportive
Public Environments
Policy Capacity Building: (for PA)
Organisational Dev.
(Bauman, 2003)
8. What to measure? Range of factors that are direct or indirect indicators of PA, or determinants of PA
Indirect measure- use of recreation facilities, parks, walking trails etc.
Direct measure- PA population survey pre and post program
Determinants of PA- perceptions of safety in the community
As well as process and partnership, capacity building issues
(Salmon & Timperio, 2003. Physical Activity Monitoring and Evaluation Toolkit)
10. Physical Activity measurement Surveys
CCHS Strength Training Program Survey
Victorian Population Health Survey
Diaries/Log books
Walking Calendars
Observation
Pedometers
Castlemaine Workplace Walking Challenge
Accelerometers
(Salmon & Timperio, 2003)
11. Measuring Physical Activity Determinants Individual measures
Self efficacy for PA
Environmental measures
Neighbourhood walkability
Social measures
Social support
(Salmon & Timperio, 2003)
12. So, with all this knowledge how do we decide:
what change we want to measure?
how best to measure this change?
13. Evaluation Planning Framework 6 steps for agencies/organisations/ partnerships to develop evaluation plans in parallel with health promotion plans
Builds on Integrated Health Promotion Resource Kit
Guidelines for asking the right questions
14. 6 steps: Describe the program
Evaluation preview
Focus the evaluation design
Collect data
Analyse and interpret data
Disseminate lessons learnt
15. 1. Describe the program Writing goals and objectives
Identifying impacts
Developing interventions
Identifying reach
16. 2. Evaluation Preview Engage stakeholders
Clarify purpose of evaluation
Identifying key questions
Identify evaluation resources
17. 3. Focus the evaluation design Specify the evaluation design
Specify the data collection methods
Locate or develop data collection instruments
18. 4. Collect data Coordinate data collection
What tasks need to be completed?
Who should undertake these tasks?
When should they be undertaken?
What resources are required to do this?
19. 5. Analyse and interpret data Analysing the data
Type of analysis driven by type of data
Interpreting the findings
20. 6. Disseminate lessons learnt What reports will be prepared?
What formats will be used?
How will findings be disseminated?
21. Task An evaluation working group from the PCP PAC has been established, you are part of this working group. Using the HP Plan provided:
What is the purpose of the evaluation? (there may be a number)
What are the key questions?
What type of evaluation design will you need to use?
What data collection methods will be most appropriate?
22. Resources CPAN Physical Activity Monitoring and Evaluation Toolkit
http://www.deakin.edu.au/hbs/cpan/PA_assessment__toolkit.pdf
CDC Physical Activity Evaluation Handbook
http://www.cdc.gov/nccdphp/dnpa/physical/handbook/index.htm
Victorian Population Health Survey
www.health.vic.gov.au/healthstatus/vphs_current.htm#download
Active Inform Bulletin (Kinect Australia)
To subscribe email physicalactivity.info@kinectaustralia.org.au
Strength training evaluation tools
For more information, Kirstan Corben k.corben@cgmc.org.au
Pedometer challenge tools
For more information, John Sawtell jsawtell@cchc.com.au
23.
Kellie Horton
Kinect Australia
e: khorton@kinectaustralia.org.au
p: (03) 8320 0127