520 likes | 535 Views
Summer @ Your Library Implementing California ’ s Outcome- and Outreach-Based Evaluation Framework. Summer @ Your Library. Overview:. The value of conducting outcome-based program planning and evaluation California ’ s Statewide Outcomes Importance of Summer Reading Outreach
E N D
Summer @ Your LibraryImplementing California’s Outcome- and Outreach-Based Evaluation Framework Summer @ Your Library
Overview: • The value of conducting outcome-based program planning and evaluation • California’s Statewide Outcomes • Importance of Summer Reading Outreach • Case Studies: Los Angeles Public Library and Glendora Public Library • Resources available from the Summer @ Your Library project Summer @ Your Library| Summer 2018
So What? • Outcomes answer the important question, So What? • What are the positive changes or benefits that people experience as a result of a library program or service? • Setting outcomes helps librarians turn outward and focus on the impact that their programs and services have on their users. Summer @ Your Library| Summer 2018
Benefits of Outcome-Based Evaluation • User-based evaluation data. • Improve existing program, terminate what’s not working, design new programs. • Develop marketing and outreach strategies for reaching specific populations. • Useful information for stakeholders and policymakers about how library services and programs benefit their constituents. Summer @ Your Library| Summer 2018
Why Do We Have Statewide Outcomes? • Help the California library community take an outcome-based approach. • Gather consistent data. • Demonstrate the impact of programs across the state. Summer @ Your Library| Summer 2018
California’s Statewide Summer Outcomes • Young children, and their parents and caregivers, and school age children, feel part of a community of readers and library users. • Teens make connections at the library. • Adults find value and enjoyment at the library. Summer @ Your Library| Summer 2018
Outreach • We have an obligation to bring the benefits of summer reading and learning programs to underserved people in our communities who may not be aware of them. Summer @ Your Library| Summer 2018
Los Angeles Public Library Summer @ Your Library| Summer 2018
Los Angeles and Summer Outcomes Planning outcomes-based summer programs since 2011! Right?! Summer @ Your Library| Summer 2018
Why Outcomes? Summer @ Your Library| Summer 2018
I can see clearly now… Summer @ Your Library| Summer 2018
Yikes Summer @ Your Library| Summer 2018
The choice is obvious Summer @ Your Library| Summer 2018
Those gorgeous Outcomes • Young children and their parents and caregivers, and school age children, feel part of a community of readers and library users. • Teens make connections at the library. • Adults find value and enjoyment at the library. Summer @ Your Library| Summer 2018
Community, connection, and enjoyment! Summer @ Your Library| Summer 2018
Community, connection and enjoyment Summer @ Your Library| Summer 2018
Community, connection and enjoyment Summer @ Your Library| Summer 2018
Quality Principles! Summer @ Your Library • Builds strong communities • Provides opportunities for learning • Celebrates reading and literacy • Is designed to reach and engage everyone Summer @ Your Library| Summer 2018
Yep, get your pencils ready Summer @ Your Library| Summer 2018
Survey results – kids, teens, adults Adults Kids Teens Summer @ Your Library| Summer 2018
What we learned • “Offer parts of the program outside the library” (Building Strong Communities) least chosen indicator • “Engage community partners” (Building Strong Communities) 2nd least chosen indicator • Also chosen less often were “Enable people to set and meet individual reading and learning goals” (Celebrating the Reading Experience) and “Activities are designed with specific learning objectives in mind” (Providing Learning Opportunities) Summer @ Your Library| Summer 2018
Summer 2018 – key indicators • All staff contribute to the program (Building Strong Communities) • Staff offers elements of the program in locations beyond the walls of the library (Building Strong Communities) • The program encourages self-directed learning, discovery and creativity (Providing Learning Opportunities) • The library enables people to set and meet individual reading and literacy goals (Celebrating Reading and Literacy) Summer @ Your Library| Summer 2018
Summer 2018 Summer @ Your Library| Summer 2018
Summer 2018 – Game board Completion = 1,000 points • 1 minute of reading = 1 point • At-home activity = 50 points • At-the-library activity = 100 points • Out and about in LA = 100 points Customize your summer reading and learning! Summer @ Your Library| Summer 2018
Summer 2018 Summer @ Your Library| Summer 2018
Glendora Public Library Summer @ Your Library| Summer 2018
What is the Glendora Summer Reading Challenge? • City-wide challenge • Open-ended to allow for all types of reading • Programs and events for readers and library users of all ages • Located on- and off-site • 150 student strong volunteer program Summer @ Your Library| Summer 2018
How Did We Get Started? 2012: Glendora Library launches Outcomes Measures Survey • CLA survey and Outcomes • Children belong to a community of readers and library users • Additional Glendora specific Outcomes • Participation in SRC helps to maintain or improve reading scores • Participation in SRC helps make reading a habit Summer @ Your Library| Summer 2018
Getting Started, continued 2013: Glendora Library located underserved population • CLA Outcome • Underserved community members participate in the summer reading program Summer @ Your Library| Summer 2018
Building a Community of Readers and Library Users • Started with making no changes to our summer programs • Readers began to add their names to the wall • (this year, readers will get a car magnet ) • Once readers reach a defined (easy to reach) level, they receive a Library-branded backpack • Once readers reach a defined (more challenging) level, they receive a yard sign Summer @ Your Library| Summer 2018
Underserved Community Members Participate in the Summer Reading Program • Glendora’s underserved community • Started with 3 sites • Now 6 sites and growing Summer @ Your Library| Summer 2018
Participation in SRC Helps Make Reading a Habit • Program designed to encourage every day reading • Incentives along the way to encourage regular Library visits Summer @ Your Library| Summer 2018
Participation in SRC Helps to Maintain or Improve Reading Scores • Based on input from local teachers • Reading goals are set in 30 minute increments • In addition to survey data, reading test score study was completed Summer @ Your Library| Summer 2018
Survey Logistics Survey created by CLA staff • Input from Glendora includes 3 extra questions added each year (stay the same every year to measure differences) • Print vs. Online vs. Email • EPIC FAIL!!! Summer @ Your Library| Summer 2018
Lessons from SRC • Readers/library users want to be included in a community and feel a part • Including all age groups in similar areas helps to build unity • Library users are proud of their Library use • SRC attracts new Library users • People LOVE to inflict torture on the Librarian Summer @ Your Library| Summer 2018
The surveys are in, now what? • Communicate with stakeholders • Community Members • Library Board • Donors (and future donors) • School Districts • Community Groups • Update programs continuously Summer @ Your Library| Summer 2018
What difference has it all made? • Increase in donor funds • Increase in the number of readers from 2,200 to over 3,300 • Increase in the amount of reading completed • 45,000 hours last summer Summer @ Your Library| Summer 2018
Is it worth it? You Bet! Summer @ Your Library| Summer 2018
Services Provided by the Summer @ Your Library Project Summer @ Your Library
Summer Reading Outcomes Surveys • Personalized survey links for participating libraries • Timeline • Set up surveys in spring • Survey period runs through summer • Custom reports returned to libraries in fall Summer @ Your Library| Summer 2018
Summer Reading Outcomes Surveys • How to Participate • Inform Summer @ Your Library project staff • Select which groups you’d like to survey • Early learners and their caregivers • School-Age Children • Teens • Adults Summer @ Your Library| Summer 2018
Surveys: Customization • Customized survey links will include: • Summer @ Your Library statewide outcomes questions • Options for respondents to report which branch they visited • Up to three questions of your choice Summer @ Your Library| Summer 2018
Surveys: Measure Local Outcomes • Add questions to measure local outcomes • Sample questions • How did you hear about summer reading? • Did you participate in SRP online or by turning in a paper log? • Did participating in SRP encourage you to read more? • What was your favorite/least favorite part of SRP? Summer @ Your Library| Summer 2018
Surveys: Evaluating Outreach Data • Resources available on calchallenge.org website • Community needs assessment • Identifying underserved groups • Outreach evaluation folded into statewide outcomes questions • Is this the first time you took part in the summer reading program? • Use surveys or conduct focus groups to gather information about target group Summer @ Your Library| Summer 2018
Surveys: Reporting Outreach Data Let us know who you’re reaching out to! (Stay tuned for more info) Summer @ Your Library| Summer 2018
Surveys: Getting participants • Paper surveys at summer activities and events • Link on your summer reading platform or library webpage • Requirement for summer reading program completion • Providing small incentives or recognition • Teens – community service time Summer @ Your Library| Summer 2018
Surveys: How to Submit Data • Unique SurveyMonkey link provided • Ways to collect • Online surveys • SRP participants fill out surveys directly into SurveyMonkey link • Paper surveys • SRP participants fill out paper surveys collected by library staff/volunteers • Hybrid Summer @ Your Library| Summer 2018
Surveys: Sample Report – LAPL 2017, Children • Statewide outcome question: Summer @ Your Library| Summer 2018
Surveys: Sample Report – LAPL 2017, Children • Local outcome question: Summer @ Your Library| Summer 2018
Surveys: Reports Summary • Survey links sent in spring • Submit data at end of summer • Receive personalized report(s) in fall • Use report(s) to demonstrate impact Summer @ Your Library| Summer 2018