240 likes | 432 Views
Effective Youth Evaluation in CNEP. Debra Garrard-Foster CNEP State Nutrition Ed. Program Coordinator Brenda Sheik CNEP Evaluator June 2013. What is Program Evaluation?. Planning a Program Evaluation; University of Wisconsin-Extension #G3658-1
E N D
Effective Youth Evaluation in CNEP Debra Garrard-Foster CNEP State Nutrition Ed. Program Coordinator Brenda Sheik CNEP Evaluator June 2013
What is Program Evaluation? Planning a Program Evaluation; University of Wisconsin-Extension #G3658-1 http://learningstore.uwex.edu/Assets/pdfs/G3658-01.pdf Program Evaluation: The thoughtful process of focusing on questions and topics of concern, collecting appropriate information, and then analyzing and interpreting the information for a specific use and purpose.
Why Evaluate Youth Programs? CNEP evaluates youth programs to: • Help us improve the program • Are youth learning the most important concepts? • Help us improve our teaching • Is there a better way to communicate what we are trying to teach, or is it working “as is” in our program? • Help others understand the value of our program - Provides program information and accountability to program funders
New Youth Evaluation System • National committee commissioned to look at youth evaluation in EFNEP • Goal was to have a uniform set of evaluation questions used by all EFNEP programs • Committee released “starter” questions in early October 2012 • Committee will continue to test reliability and validity of the questions • Additional changes to questions likely
New Youth Evaluation System • Questions are not curriculum-specific, rather they are based on the goals and objectives of CNEP • Two year phase in time for project with full use by FY 2015 • Questions are intended for use with WebNEERS system • Evaluation tools only in English
New Youth Evaluation System • During the phase-in period OSU CNEP has: • Determined best strategies for using evaluation questions with our groups • Determined best method for matching pre and post evaluations We need your help as front-line youth NEAs to help make this transition a good one!
Youth Questions The evaluation tools include questions aligned with what children should be learning about nutrition… The National Committee Prepared 4 Sets of Evaluation Tools: Kindergarten to Second Grade Third Grade to Fifth Grade Sixth Grade to Eighth Grade Ninth Grade to Twelfth Grade
3RD GRADE TO 5TH GRADE TOOL • Will be used with 3rd and 4th grades What Tools Will CNEP Use?
Other Changes? Parent and/or child can opt outChild will use ID code on pre/postYouth pre/post matchedNEAs will use survey script (at first!)Data entry in WebNEERS
Parent/Guardian Information Sheet Required by IRB Sent from and returned to school Give at least one week to return Teacher to help track
No return/no signature= Evaluation OK Tell child to opt out = NO Evaluation Child opts out on own = NO Evaluation Parent signs & returns = NO Evaluation Parents’/Youth choices No Evaluation if parents not given form or time to complete!
No evaluation means no evaluations are even handed to the child……it does not mean that the child can take the survey and then the survey can be destroyed.
Students will now write ID on pre/post Can use student’s 2 or 3 initials or school assigned ID for surveys No student names on surveys Do not make any changes to surveys or write school or teacher names, etc. Youth Pre/Post Be consistent with IDs……use same method of ID on both sets of pre and post
2-3 student initials or school assigned student ID……unit may want to decide! Prefill date and indicate pre or post before copied. NEA is to match each student’s pre and post Submit unmatched: (same initials, absent from pre or post, etc.) Youth Pre/Post Matched
Script Script: instructions for student code keeps all on same question reassures not a TEST! Use at first……you will know when you can stop. IMPORTANT!
Data Entry Youth groups entered as always Matched surveys entered into Youth Checklist tab Select 3rd-5th tool and “Add Checklist” Enter student ID, survey dates and responses You can’t enter more checklists than you have youth enrolled in the group
Start to Finish Process Parent Info Form to schools Complete youth group enrollment Pre Survey at/before first lesson (did any parent opt out?) Submit group enrollment to unit office/hold Pre Survey Lessons Post Survey at last lesson
Start to Finish Process (cont.) Match Pre/Post and complete exit form. Submit exit form, matched pre/post and mismatched surveys to unit office Submit paperwork as soon as that step is complete. Do not hold till quarterly reports!!!
Thanks Texas! (we still plan to beat you in football!!) This presentation was adapted from a PowerPoint prepared by