Outcome Measures for Eurekans

1. Outcome Measures for Eurekans Dr. Cindy Mediavilla Library Programs Consultant Monday, March 3, 2014 12 Noon Pacific

2. Outcome Measures Experience Let’s take a Poll

3. What are some of the most difficult aspects of using outcomes to plan and evaluate library services? To start our conversation, Type your thoughts into the chat box.

4. Defining “Outcomes:” • How our services impact a particular target population • The benefits derived from using the library

5. Outcomes result in a positive change in a person’s: • Attitude • Behavior • Knowledge • Skill(s) • Life status/Condition

6. Why use outcomes? • Demonstrate the library’s value, instead of its workload • Tell the stories behind library statistics • Measure how the library helped effect positive change in the community • Stakeholders understand benefits better than numbers

7. Outcomes terminology

8. Inputs = • Internal resources the library uses to provide service

9. Example: Textbooks + after-school teacher/tutor (inputs)  Borderline students pass math class

10. Outputs = • How much a library service or resource is used

11. Outputs vs. outcomes • Tallies vs. results

12. Implementing outcomes • Identify community needs/interests • Determine what changes (outcomes) need to occur • Design library programs/services to effect change • Evaluate whether positive change (outcomes) occurred

13. Backwards design: • Create target outcomes before designing program/services—i.e., the “If . . . Then” scenario

14. Outcome statements: • Focused on benefits to the end-user, not on library outputs • Realistic and achievable – don’t try to change the entire world! • Measurable

15. Example statements: • As a result of using the library’s after-school homework center, 45% of borderline students will pass their math class (change in knowledge) • 50% of participants will indicate they can now use their e-readers after receiving the library’s one-on-one e-reader training (change in skill) • As a result of attending the library’s “History of Rock ‘n Roll” lecture/film series, 60% of teens will say they have a greater appreciation for 1960s rock music (change in attitude)

16. Measuring outcomes: • Decide evaluation strategy at the beginning of the project planning process • If possible, pre- and post-test to measure change

17. Defining “evaluation:” • Measures the effectiveness of services/programs the library provides • Can occur while (formative evaluation) or after (summative evaluation) a program/service is delivered

18. Why evaluate? • Gauge the library’s performance, as well as diagnose problem areas • Document the library’s effectiveness • Demonstrate the library’s commitment to providing excellent service

19. Data collection techniques by outcome type:

20. Challenges of measuring outcomes: • Whole new way of measuring what the library does (benefits vs. numbers) • Often difficult to capture outcomes, especially if results aren’t immediate or readily observable • Data may seem too “soft” or anecdotal • Cannot always assume that the outcomes, by themselves, led to change

21. Outcomes and grant proposals: • Funders want to know what impact your proposed project will have on the community • What changes will occur as a result of your grant project? • Objectives vs. outcomes

22. Questions?

23. Thank you. Cindy.Mediavilla@library.ca.gov

24. Infopeople webinars are supported in part by the U.S. Institute of Museum and Library Services under the provisions of the Library Services and Technology Act, administered in California by the State Librarian. This material is licensed under a Creative Commons 3.0 Share & Share-Alike license. Use of this material should credit the author and funding source.