120 likes | 236 Views
Rec 3530 Program Planning in Recreation and Parks. Chapter 15 Evaluation Steps One fundamental of evaluation… Friend to Groucho Marx: “Life is difficult!” Marx to Friend: “Compared to what?”. Steps in Evaluating a Program. Preparing an Evaluation Proposal Designing the Study
E N D
Rec 3530Program Planning in Recreation and Parks Chapter 15 Evaluation Steps One fundamental of evaluation… Friend to Groucho Marx: “Life is difficult!”Marx to Friend: “Compared to what?”
Steps in Evaluating a Program • Preparing an Evaluation Proposal • Designing the Study • Selecting a Sample • Collecting Information • Interpreting the Information Gathered • Preparing the Final Report • Putting Findings into Action
1. Preparing an Evaluation Proposal A proposal is HOW you intend to carry out the study, and contains these sections: • Introduction • Literature review • Study design & methods • Timeline • Personnel • Budget • Dissemination plan
2. Designing the Study Consider: *What are the information needs of the programmer and agency? *What are the evaluation project constraints? *How can you best protect study participants? *How rigorous must future program decisions be?
Designing the Study, cont. • Control group, pretest---posttest • One-group pretest---posttest • Survey design • Ethnographic Study Design • Case study • Content analysis
3. Selecting a Sample The most important consideration is the representativeness of the sample. • Simple Random sampling • Stratified Random sampling • Systematic Random sampling • Purposive Sampling • Snowball Sampling
4. Collecting Information • Questionnaires and structured interviews • Unstructured interviews -Focus group • Participant Observation • Continuous documents (public) • Episodic records (usually private) • Nonreactive measures
5. Interpreting the Information Gathered • Quantitative Data Analysis • Descriptive statistics • Frequency distribution • Measures of central tendency • Measures of variability • Measures of relationship • Inferential statistics • “T-test” • Analysis of Variance (ANOVA)
Interpreting the Information Gathered, cont. • Qualitative Data Analysis (several types of approaches), basically: • Prepare notes • Focus the data • Display the data • Draw conclusions
6. Preparing the Final Report The evaluation report answers the evaluation question as well as making recommendationsfor future action. It contains: • The evaluation issue, question or problem • Background information (literature review) • Methods and procedures of data gathering • Results and analyses • Conclusion • Recommendations for decision-making
7. Putting Findings into Action The point of evaluation is to use data as the basis for suggesting courses of action. Ways to put findings into action: • Call a staff meeting • Meet with organization policy makers • Prepare a simple version of report for newspaper • Present findings at a professional conference • Insert results into organization’s program catalog ***