1 / 25

Fall 2013: Multi-State Conference Program Director’s Meeting

Kentucky 21 st Century Community Learning Centers. Fall 2013: Multi-State Conference Program Director’s Meeting. Site Visit, PQA Results and Next Steps Center for Evaluation & Education Policy Indiana University. Presentation Overview. Introduction Spring 2013 Site Visit Results

lenci
Download Presentation

Fall 2013: Multi-State Conference Program Director’s Meeting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Kentucky 21st Century Community Learning Centers Fall 2013: Multi-State Conference Program Director’s Meeting Site Visit, PQA Results and Next Steps Center for Evaluation & Education Policy Indiana University

  2. Presentation Overview Introduction Spring 2013 Site Visit Results 2013 PQA Results Quality Improvement System and Next Steps

  3. Spring 2013 Site Visits Who? What? • 28 visits to Cycle 9 KY 21st CCLC programs • February 18 through April 18, 2013 How? • Site coordinator interview • School day teacher interview • Standardized observation protocol for academic and enrichment activities

  4. Site Visit Rating System Rating System: • 12 Items • (rated on a scale of 1 to 4) • 1 = Must Address and Improve • 2 = Some Progress Made • 3 = Satisfactory • 4 = Excellent • 48 Possible Points

  5. Site Visits (CEEP) Purpose of 2013 Site Visits High School Programs Activities promote academic growth, remediation, and development Links to the regular school day Participants contribute ideas, make choices, and having positive experiences Establish partnerships and employ successful recruitment strategies Elementary/Middle School Programs Activities geared toward rigorous academic enrichment Links to the regular school day Individual support and opportunities for positive interactions for youth Relationships with schools, parents, and other community constituents

  6. Average Ratings of the Four Focus AreasN=21

  7. Average Rating of Each Item within the Four Focus Areas

  8. How to Target Rigorous Academic Achievement in Elementary/Middle Schools High Quality HW- Help – Staff circulate and work one-on-one with students, homework alternatives are available, maintain an environment conducive to homework completion (i.e. minimal noise/adequate space) Supplemental Academic Enrichment – Include activities with clear academic content, links to academic content are explicitly explained by staff, ongoing units centered around themes or skill sets Opportunities for Active Learning – Provide activities that include youth creating and reforming tangible products, applicable to the “real world”, links to STEM concepts and incorporate reflection

  9. Average Ratings of the Four Focus Areas(N=7)

  10. Average Rating of Each Item within the Four Focus Areas

  11. High School Site Visit Results Cross Year Comparison of Activities Offered by Sites

  12. Kentucky 21st CCLC 2013-2014 Action Plan

  13. Federal Recommendations for Kentucky 21st CCLC Programs Kentucky must demonstrate that systems are in place for quality control and technical assistance. Programs must demonstrate that data are being used for continual improvement. 3. Programs must demonstrate increased ability to achieve results.

  14. What is program quality? Program staff ??? outcomes students training youth program Another way to say it…What do we want to see in high quality youth programs?

  15. What is the Program Quality Assessment? 1. A validated instrument designed to assess the quality of youth programs and identify staff training needs. 2. A set of items that measures youth access to key developmental experiences. 3. A tool which produces scores that can be used for comparison and assessment of progress over time.

  16. PQA: The Pyramid of Program Quality Plan Make choices Engagement Reflect Lead and mentor Be in small groups Partner with adults Interaction Experience belonging Encouragement Reframing conflict Supportive Environment Skill building Session flow Active engagement Welcoming atmosphere Psychological and emotional safety Safe Environment Program space and furniture Emergency procedures Healthy food and drinks Physically safe environment Youth Voice and Governance Professional Learning Community

  17. Quality Improvement System (QIS) Self Assessment Data • A self assessment team (usually a program director and site coordinator) observed two program activities. • Activities observed included an academic enrichment and social/cultural enrichment activity. • Each site entered data from self assessment forms into the online system Scores Reporter. • Sites used a self-assessment form for school age youth or older youth, depending on the grade levels of students served.

  18. Quality Improvement System (QIS) Self Assessment Observation Scores • Keep in mind… • Observation scores represent a snapshot – this has limitations and value. • These are aggregate scores from multiple observations. • The overall story is more important than the individual numbers. • What you do with the data matters most!

  19. Average Self Assessment Scores Assigned Per Domain Across Sites

  20. Quality Improvement System (QIS) External Assessment Data • External assessments were conducted for 14 sites in cycle 9 during the spring 2013 site visits. • Sites in cycle 9 were randomly selected based on external assessor availability. • Assessments were conducted to give sites the opportunity to compare self-assessment results to those conducted by someone external to the program.

  21. Quality Improvement System (QIS) External Assessor Observation Scores • Keep in mind… • External assessment scores are always lower than self assessment scores. • Observation scores represent a snapshot – this has limitations and value. • The overall story is more important than the individual numbers. • What you do with the data matters most!

  22. Quality Improvement System (QIS) How to target PQA Areas for Improvement: • Interaction— Structured opportunities for getting to know one another, various types of groupings, opportunities to acknowledge the achievements of the youth, youth have opportunities to mentor others, or lead groups • Engagement— The youth have opportunity to make plans, youth can reflect on their activities, youth make presentations to the whole group, youth can make open-ended choices within activities

  23. 2014 PQA Kentucky 21st CCLCSelf-Assessment Process: Tentative Timeline

  24. Quality Improvement System (QIS) What Happens Next? • Year 2013 Participants: • New program staff selected to be on the 2014 Self Assessment team should attend the basics training. • Those who have not yet participated in the QIS (cycle 10 expansion and new grantees) • Required to enroll a Self-Assessment Team in the 2014 Quality Improvement System. Team members typically include the Program Director and Site Coordinator.

  25. Kentucky 21st Century Community Learning Centers Fall 2013: Multi-State Conference Program Director’s Meeting Questions? Stephanie Schmalensee, Research Associate sorland@indiana.edu LeeAnn Sell, Evaluation Coordinator ky21cclc@indiana.edu

More Related