1 / 23

Family Literacy Professional Development Workshop

Family Literacy Professional Development Workshop. Iowa Department of Education Division of Community Colleges and Workforce Preparation Iowa State University * Iowa State Center February 22, 2006. Family Literacy Professional Development Workshop. Making Evaluation Count

ciel
Download Presentation

Family Literacy Professional Development Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Family Literacy Professional Development Workshop Iowa Department of Education Division of Community Colleges and Workforce Preparation Iowa State University * Iowa State Center February 22, 2006

  2. Family Literacy Professional Development Workshop Making Evaluation Count Sharon Drake, Ph.D.

  3. What we’ll cover • A “Big Picture” view of Family Literacy in Iowa Community Colleges • A generic model for programming and accountability • Announce new DOE funding and apply model to funding application • Create some common language • Share program efforts with colleagues • Consider data collection methods • Turning data into impact statements • Q and A

  4. EVALUATION: What do you (and others) want to know about this program?

  5. “I think you should be more explicit here in Step Two.”

  6. Accountability Era • What gets measured gets done. • If you don’t measure results, you can’t tell success from failure. • If you can’t see success, you can’t reward it. • If you can’t reward success, you’re probably rewarding failure. • If you can’t see success, you can’t learn from it. • If you can’t recognize failure, you can’t correct it. • If you can demonstrate results, you can win public support. Osborne and Gaebler, 1992

  7. Results is the name of the game! “The important question any constituent needs to ask is whether or not the program achieves results.” President Bush, NPR news, 2-7, 05

  8. What we are striving for: • Provide a common language • Helps us differentiate between “what we do” and “results” --- outcomes • Increases understanding about program • Guides and help focus work • Lead to improved planning and management • Increases intentionality and purpose • Provides coherence across complex tasks, diverse environments

  9. » » » » Inputs Outputs Outcomes Outcomes Outcomes Activities Participation Generic Program Model Program Goal: (Stated in terms of targeted population and expected outcomes or impact of the program.) Strategy Results Objectives (participant focused) C O N T E X T (Situation) A diagram of the theory of how a program is supposed to work A graphic depiction of relationships between activities and results

  10. » » » » Inputs Outputs Outcomes Outcomes Outcomes Activities Participation Generic Program Evaluation Model Program Goal: (Stated in terms of targeted population and expected outcomes or impact of the program.) Strategy Results Objectives (participant focused) Impact Outcomes (Summative) Needs Process (Formative) Evaluation (Focus – Collect Data – Analyze and interpret –Report) Evidence

  11. Language: What do you mean by… • Formative = Process =Developmental • Summative = Outcomes/Impact • Goal = Impact • Impact = Long-term outcome • Objectives (participant focused) = Outcomes • Activities = Outputs • Outputs may signify “tangible” accomplishments as a result of activities

  12. Outcomes-Impact-Measurement and Reporting

  13. EVALUATION QUESTIONS: What do you (and others) want to know about this program?

  14. EVALUATION Questions: What do you (and others) want to know about this program? Goals: Outcomes Objectives Targeted Population Parents increase knowledge of child dev Develop parent ed curriculum Staff Parents identify appropriate actions to take Improved child-parent relations Targeted parents attend Money Deliver series of interactivessessions Parents better understand their own parenting style Partners Research Facilitate support groups Parents use effective parenting practices Parents gain skills in effective parenting practices Strong families

  15. Evaluation Questions: What do you (and others) want to know about this program? Goals: Outcomes (Objectives) Parents increase knowledge of child dev Outputs Targeted Population Parents identify appropriate actions to take Develop parent ed curriculum Staff Targeted parents attend Improved child-parent relations Money Parents better understand their own parenting style Deliver series of interactivessessions Partners Parents use effective parenting practices Research Parents gain skills in effective parenting practices Strong families Facilitate support groups To what extent did behaviors change? For whom? Why? What else happened? To what extent are relations improved? Does this result in stronger families? What amount of $ and time were invested? How many sessions were actually delivered? How effectively? # and quality of support groups? Who/how many attended/did not attend? Did they attend all sessions? Supports groups? Were they satisfied – will they come again? To what extent did knowledge and skills increase? For whom? Why? What else happened?

  16. » » » » Inputs Outputs Outcomes Outcomes Outcomes Activities Participation Generic Program Model Program Goal: (Stated in terms of targeted population and expected outcomes or impact of the program.) Results Strategy Impact Outcomes (Summative) Needs Process (Formative) Evaluation Questions

  17. » » » » Inputs Outputs Outcomes Outcomes Outcomes Activities Participation Generic Program Model Program Goal: (Stated in terms of targeted population and expected outcomes or impact of the program.) Results Strategy Impact Outcomes Needs Process Evaluation Questions Outcome evaluation: To what extent are desired changes occurring? For whom? Are the results worth the costs? Is the program making a difference? What seems to work? Not work? What are unintended outcomes? Process evaluation: How is program implemented? Fidelity of implementation? Are activities delivered as intended? Are participants being reached as intended? What are participant reactions? Needs assessment:: What are the characteristics, needs, priorities of target population? What are potential barriers/facilitators? What is most appropriate?

  18. “Collecting data is like collecting garbage; you must know in advance what you are going to do with the stuff before you collect it.” Mark Twain

  19. Evaluation Planning Funding Period 1/01/06-12/01/06 Family Literacy in Iowa Community Colleges

  20. FORMATIVE EVALUATION (process) Funding Period: 09/01/05-06/30/06 FAMILY LITERACY IN IOWA COMMUNITY COLLEGES

  21. » » » » Inputs Outputs Outcomes Outcomes Outcomes Activities Participation Generic Program Model Program Goal: (Stated in terms of targeted population and expected outcomes or impact of the program.) Strategy Results Objectives (participant focused) Impact Outcomes (Summative) Needs Process (Formative) Evaluation (Focus – Collect Data – Analyze and interpret –Report) Evidence

  22. Reporting Your Success Story Impact Results Medium Short Evidence Data Response Situation Participants Activities Needs

  23. What questions do you have? What do you want to discuss?

More Related