1 / 25

Georgia Pilot Site Technical Assistance Meeting

Georgia Pilot Site Technical Assistance Meeting. Wednesday, January 19, 2011 10 am ET. The Process in More Detail: Where Are You?. The Five Step Process. STE P FOUR. Develop an Evaluation Plan. Why Evaluate?.

stacey-reyes
Download Presentation

Georgia Pilot Site Technical Assistance Meeting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Georgia Pilot Site Technical Assistance Meeting Wednesday, January 19, 2011 10 am ET

  2. The Process in More Detail: Where Are You?

  3. The Five Step Process

  4. STEP FOUR Develop an Evaluation Plan

  5. Why Evaluate? Make sure your improvement strategy works somewhere before you attempt to apply it everywhere

  6. Types of Evaluations • Formative Evaluation • Process measures • How well was the program implemented • “The cook tasting the soup” • Summative Evaluation • Outcome measures • Did the program produce the desired results • “The guests taste the soup”

  7. Write SMART Objectives • Evaluation objectives must be • Specific • Measurable • Achievable • Relevant • Time-limited

  8. Formative (Process) Evaluation What we all know and do well

  9. Select Process Measures • Attendance • Response rate • Satisfaction of implementers with process • Satisfaction of participants with process • On time accomplishment of tasks • Quality evaluation of implementation services • More

  10. Process Objectives • 75% of invitees will respond to the invitation by the RSVP date • 60% of the invitees will attend the event • 50% of the participants will bring at least one parent or guardian to the event • 75% of the participants will score their satisfaction with the event as a 4 (very good) or 5 (excellent) on the exit evaluation instrument

  11. Process Measurement Tools • Invitation/Outreach records • Registration/Response records • Attendance records • Participant demographics • Evaluation instrument • Planning timeline • More

  12. Develop a Process Evaluation Plan

  13. Summative (Outcome) Evaluation The ultimate impact of our efforts RESULTS

  14. Select Outcome Measures • Short-term goals • Increase in awareness • Increase in knowledge • Change in attitude • Change in behavior • Long-term goals • Enrollment • Achievement • Completion • Graduation • Transition

  15. Long-term Goals and Objectives • Increase the participation of females in Ag • From FY09 to FY11, female enrollment in Ag 010101 will increase by 5 percentage points as measured by Overton Banner Data Collection System. • Increase the participation of females in PLTW • The participation rate of girls in the Gateway to Technology course at the middle school will increase by 5 percentage points the year following the implementation of the Focus Your Future event as measured by Perkins reported enrollment data

  16. Long Term Measurement Tools Typically maintained by administration or institutional research office and reported to a funder, accrediting agency or system agency • Student level demographic data • Attendance records • Achievement records • Graduation records • Perkins core indicator data

  17. Select Outcome Measures • Short-term goals • Increase in awareness • Increase in knowledge • Change in attitude • Change in behavior • Long-term goals • Enrollment • Achievement • Completion • Graduation • Transition

  18. Short-term Objectives • 80% of participants in Female Farm Today workshop will increase their knowledge of farm business practices as measured in pre-and post-workshop survey. • After participating in Focus Your Future event 50% of the participating students will show a one point (on a 5 point likert scale) increase in their willingness to consider enrolling in the pre-engineering program at the high school.

  19. Short-term Measurement Tools • Pre-post attitude assessment • Pre-post knowledge assessment • Evaluation instrument • Post activity survey

  20. Develop a Outcome Evaluation Plan

  21. Assessment Resources • STEM Equity Pipeline Webinars • May 21, 2008 Assessing Effectiveness: Do Your Program Activities Make a Difference? • June 16, 2008 Building Effective Program Assessments • Archived at www.stemequitypipeline.org • Assessing Women and Men in Engineering - www.aweonline.org

  22. Summary • Align short term goals with long term goals • Tie long term objectives to existing data collection systems • Tie short term objectives to activities • Check for any required data • Determine types of data needed— quantitative, qualitative, or both? • Decide on a data collection instrument • Assessing Women in Engineering • Develop an Evaluation Plan

  23. Questions

More Related