Making Usage Data Meaningful a consortium ’ s attempt to better understand eResource usage

1. Making Usage Data Meaningful a consortium’s attempt to better understand eResource usage Project Team Jill Morris, Assistant Director Emily Guhde, Online Services Librarian Tim Rogers, Executive Director • Usage Data Advisory Group • Member libraries • State Library of North Carolina • EBSCO • ProQuest @nclive @jillianemorris @ea_guhde

2. Usage Data Advisory Group Robert Antill, Fayetteville Technical Community College Susanna Boylston, Davidson College Patrick Carr, East Carolina University Deana Guido, Nash Community College Debbie Hargett, Wingate University Derrik Hiatt, Wake Forest University Terry Hill, Durham County Public Library Doug Short, Central Piedmont Community College Mary Sizemore, High Point Public Library John Vickery, NC State University Rob Wolf, UNC-Pembroke Lynda James-Gilboe , ProQuest Dawn Zehner, ProQuest Scott Bernier, EBSCO Steve O’Dell, EBSCO Tim Bucknall, UNC-Greensboro and Carolina Consortium (Ex-Officio) Joyce Chapman, State Library of North Carolina (Ex-Officio)

3. The Consortium Perspective: • Data to make decisions about NC LIVE services • Examples: • How do we decrease cost-per-use/maximize ROI? • How do authentication methods impact use? • What kind of impact do discovery tools have? • Are libraries downloading and using usage statistics via nclive.org?

4. The Library Perspective: What kind of use should we be seeing for our library?

5. The Library Perspective: What kind of use should we be seeing for our library? What can we do to improve use of these resources?

6. Research Project Objectives: Identify peer groupings of North Carolina libraries Identify data points to measure usage of each studied database Develop a framework for creating usage benchmarks in each peer group Analyze and report qualities of “high usage” libraries

7. This study does not: • Determine if a library’s use is “good” or “bad” • Determine if a database’s use is “good” or “bad” • Define the value of NC LIVE-provided databases • Explain why certain factors may impact database use

8. Objective 1: Identify peer groupings of North Carolina libraries • Gathered basic information about libraries • Decided what information to use as criteria for grouping • Formed peer groups

9. Objective 1: Identify peer groupings of North Carolina libraries

10. Objective 2: Identify data points to measure usage of each studied database Use = ? Searches? Sessions? Full Text Views?

11. Definitions of Use

12. Objective 3: Develop a framework for creating usage benchmarks in each peer group

13. High: 19.19 Low: 2.89 Mean: 10.12 Median: 9.48

14. Peer Group and Benchmarking Analysis • No one library is at the very top or bottom of its peer group for usage across all resources • Database use varies widely, even among peer institutions • Summit Feedback: • Flexible peer groups may be more useful than permanent peer groups

15. Objective 4: Analyze and report qualities of “high usage” libraries

16. Objective 4: Analyze and report qualities of “high usage” libraries

17. Objective 4: Analyze and report qualities of “high usage” libraries • Qualities such as: • Access & Authentication • Content & Collections • Awareness, Outreach & Support • Community Characteristics • Library Characteristics

18. Objective 4: Analyze and report qualities of “high usage” libraries • Qualities such as: • Access & Authentication • Content & Collections • Awareness, Outreach & Support • Community Characteristics • Library Characteristics • Analyses: • Cross-tabs • Difference of means tests • Multiple regression

19. Community College Libraries

20. Trends among libraries in the top third of their peer groups* Community College Libraries

21. Trends among libraries in the top third of their peer groups* *Academic Search Complete Use Community College Libraries

22. Direct Links to NC LIVE-Provided Resources Community College Libraries

23. Librarians Attend Faculty Meetings Community College Libraries

24. NC LIVE Committee Representation Community College Libraries

25. High Number of Total Information Services Per FTE Community College Libraries

26. High Number of Circulation Transactions Per FTE Community College Libraries

27. Trends among variables, across all databases Community College Libraries

28. Librarian-faculty interactions are related to higher database use. • Embedded Librarians in Academic Courses • Librarian-Initiated Engagement with Academic Departments • Library Orientation Programs for Faculty Members • Marketing Aimed at Faculty Members • Librarians Attending Faculty Meetings Community College Libraries

29. Four-Year College and University Libraries

30. Trends among libraries in the top third of their peer groups* Four-Year College and University Libraries

31. Trends among libraries in the top third of their peer groups* *Academic Search Complete Use Four-Year College and University Libraries

32. Authenticate with a Local Proxy Four-Year College and University Libraries

33. Direct Links to NC LIVE-Provided Resources Four-Year College and University Libraries

34. Number of Librarians Per 1,000 FTE Four-Year College and University Libraries

35. NC LIVE Committee Representation Four-Year College and University Libraries

36. Trends among variables, across all databases Four-Year College and University Libraries

37. The ways that library users access databases are related to use. Higher use Authenticate with a Local Proxy Federated Search Service Lower Use Link to the NC LIVE Website Authenticate with a Password Display an NC LIVE Search Box Display Descriptive Text About NC LIVE Four-Year College and University Libraries

38. Community College Libraries & Four-Year College and University Libraries

39. Variables that predict use Community College Libraries & Four-Year College and University Libraries

40. Authenticate with a Local Proxy • Discovery Service • Chat Reference Box • Mobile Library Website or App • Electronic Materials Expenditures Per Full Time Enrollment • Staff Training for NC LIVE-Provided Resources • NC LIVE Committee Representation • Total Library Expenditures Per Full Time Enrollment • Number of Librarians Per 1,000 of Full Time Enrollment • Librarian-Initiated Engagement With Academic Departments • UNC Institution • NCICU Institution Community College Libraries & Four-Year College and University Libraries

41. Authenticate with a Local Proxy • Discovery Service • Chat Reference Box • Mobile Library Website or App • Electronic Materials Expenditures Per Full Time Enrollment • Staff Training for NC LIVE-Provided Resources • NC LIVE Committee Representation • Total Library Expenditures Per Full Time Enrollment • Number of Librarians Per 1,000 of Full Time Enrollment • Librarian-Initiated Engagement With Academic Departments • UNC Institution • NCICU Institution Community College Libraries & Four-Year College and University Libraries

42. Hmm, what is the NC LIVE password? Community College Libraries & Four-Year College and University Libraries

43. Hmm, what is the NC LIVE password? Community College Libraries & Four-Year College and University Libraries

44. Hmm, what is the NC LIVE password? Community College Libraries & Four-Year College and University Libraries

45. Public Libraries

46. Trends among libraries in the top third of their peer groups* Public Libraries

47. Trends among libraries in the top third of their peer groups* *Academic Search Complete Use Public Libraries

48. Direct Links to NC LIVE-Provided Resources Public Libraries

49. Chat Reference Box Public Libraries

50. High Number of Statistics Downloads Public Libraries