“22 items and a box”

1. “22 items and a box” Martha Kyrillidou Association of Research Libraries NELA Boston, MA September 28, 2004 old.libqual.org

2. The Association of Research Libraries Mission: Shaping and influencing forces affecting the future of research libraries in the process of scholarly communication. Members: 123 major research libraries in North America. Ratios: 4% of the higher education institutions providing 40% of the information resources. Users: 3 million students and faculty served. Expenditures: $2.48 billion annually, $954 million for acquisitions of which 20% is invested in access to electronic resources. www. ASSOCIATIONOF RESEARCH LIBRARIES old.libqual.org

3. Assessment “The difficulty lies in trying to find a single model or set of simple indicators that can be used by different institutions, and that will compare something across large groups that is by definition only locally applicable—i.e., how well a library meets the needs of its institution. Librarians have either made do with oversimplified national data or have undertaken customized local evaluations of effectiveness, but there has not been devised an effective way to link the two.” Sarah Pritchard, Library Trends, 1996 old.libqual.org

4. The Challenge of Assessment in Libraries • Traditional statistics emphasize inputs, expenditures, acquisitions, holdings, etc. • Helping funding agencies understand success of investment • No demonstrable relationship between expenditures and service quality • Lack of metrics describing outcomes: success from the user’s point of view • Need to redesign library services to better meet changing patterns of use • Building the climate, tools, and skill set for library assessment old.libqual.org

5. ARL New Measures Initiative • Collaboration among member leaders with strong interest in this area • Specific projects developed with different models for exploration • Intent to make resulting tools and methodologies available to full membership and wider community old.libqual.org

6. ….only customers judge quality; all other judgments are essentially irrelevant” Zeithaml, Parasuraman, Berry. (1999). Delivering quality service. NY: The Free Press. old.libqual.org

7. LibQUAL+™ Goals • Improve mechanisms and protocols for evaluating libraries • Develop web-based tools for assessing library service quality • Identify best practices in providing library service • Support libraries seeking to understand changes in user behavior • Assist libraries seeking to re-position library services in the new environment old.libqual.org

8. LibQUAL+™ Outcomes • Securing information that contributes meaningfully to planning and improvement efforts at a local level • Providing analytical frameworks that institutional staff can apply without extensive training or assistance • Helping decision-makers understand success of investments • Finding useful inter-institutional comparisons old.libqual.org

9. LibQUAL+™ Resources • An ARL/Texas A&M University joint developmental effort based on SERVQUAL. • LibQUAL+ ™ initially supported by a 3-year grant from the U.S. Department of Education’s Fund for the Improvement of Post-Secondary Education (FIPSE) • Initial project established a expert team, re-grounded SERVQUAL concepts, and designed survey methodology • Survey conducted at over 500 libraries resulting in a data base of over half a million user responses • NSF funded project to refocus LibQUAL+™ on the National Science Digital Library (NSDL) old.libqual.org

10. “22 items” old.libqual.org

11. old.libqual.org

12. old.libqual.org

13. old.libqual.org

14. Survey Structure – Page 2(Detail View) old.libqual.org

15. Key to Radar Charts old.libqual.org

16. old.libqual.org

17. old.libqual.org

18. old.libqual.org

19. old.libqual.org

20. old.libqual.org

21. Key to Bar Charts old.libqual.org

22. LibQUAL+™ 2004 Summary Colleges or UniversitiesAmerican English (n = 69,449) old.libqual.org

23. LibQUAL+™ Growth old.libqual.org

24. 2004 LibQUAL+™ Survey Activity old.libqual.org

25. LibQUAL+™ 2004 by the Numbers old.libqual.org

26. Languages American English British English French Dutch Swedish Consortia Each may create 5 local questions to add to their survey Types of Institutions Academic Health Sciences Academic Law Academic Military College or University Community College European Business Hospital Public State Countries - U.S., U.K., Canada, the Netherlands, Sweden, France, Australia Rapid Growth in Other Areas old.libqual.org

27. The Box About 40% of participants provide open-ended comments, and these are linked to demographics and quantitative data. old.libqual.org

28. Library Values • Library values are reflected in: • physical environment (Library as Space) • warmth, empathy, reliability and assurance of library staff (Affect of Service) • ability to control the information universe in an efficient way (Information Control) • and are unifying and powerful forces for: • Overcoming language and cultural barriers • Bridging the worlds of our users • Improving library services • Advancing the betterment of individuals and societies old.libqual.org

29. In Closing • LibQUAL+™ methodology focuses on success from the users point of view (outcomes) • Demonstrates that a web-based survey can handle large numbers; users are willing to fill it out; and survey can be executed quickly with minimal expense • LibQUAL+™ requires limited local survey expertise and resources • Analysis available at local and inter-institutional levels • Many opportunities for using demographics to discern user behaviors old.libqual.org

30. Multiple methods • Transactional surveys* • Mystery shopping • New, declining, and lost-customer surveys • Focus group interviews • Customer advisory panels • Service reviews • Customer complaint, comment, and inquiry capture • Total market surveys* • Employee field reporting • Employee surveys • Service operating data capture *A SERVQUAL-type instrument is most suitable for these methods Note. A. Parasuraman. The SERVQUAL Model: Its Evolution And Current Status. (2000). Paper presented at ARL Symposium on Measuring Service Quality, Washington, D.C. old.libqual.org

31. Discussion • Understand how to interpret radar charts, bar charts, and identifying differences among user groups • Identify immediate actions your library can take to improve the service quality scores • Identify long-term actions that your library can take to improve library services old.libqual.org

32. Short-term actions • Improve DD/ILL, scan articles • Proxy servers, marketing, db of the month, report to faculty, communication, usability • Other methods to talk/listen to users • Publicize data and use of information • Outreach/communication • Share info with the staff • Use library faculty communication channels old.libqual.org

33. LibQUAL+™ Resources • LibQUAL+™ Website:http://www.libqual.org • Publications:http://www.libqual.org/publications • Events and Training: http://www.libqual.org/events • LibQUAL+™ Bibliography: http://www.coe.tamu.edu/~bthompson/servqbib • LibQUAL+™ Procedures Manual:http://www.libqual.org/Information/Manual/index.cfm old.libqual.org

34. old.libqual.org

35. Martha Kyrillidou Director ARL Statistics and Measurement Program martha@arl.org old.libqual.org