E-Use Measurement: A Detour Around the Publishers ALCTS | Summer 2005

1. E-Use Measurement: A Detour Around the Publishers ALCTS | Summer 2005 Joe Zucca Assessment, Planning and Publications Librarian University of Pennsylvania Library

2. Stouffer N=345 Kings Court N=358 ALCTS Summer 2005 Student Use of E-Resources: Three Profiles by Residence logins per capita, by hour. Feb ‘03-May ’05 [49,857 logins total] Harnwell N=757 Avr. Login per Resident Hour of Day

3. ALCTS Summer 2005 The Top 15 Titles by Use, Comparative Ranks: 3 Houses and All Users

4. ALCTS Summer 2005 Key Attributes of Metrics and Measurement Processes Metrics Comprehensive [Licensed Stuff, Local, Public] Consistent [Uniform Across Resources, Replicable] Context-Sensitive [Location, Time, Demographic, Cost, Resource Type & Class, Need] Processes-Data Granular, Normalized, Integrative, Anonymous Processes-Architecture Scaleable, Efficient (high output for low effort), Sustainable, Distributed

5. 4. Pass to vendor site 1. User initiates a session using pages spawned by a database 2. Db swaps handle for authentic url 3. Proxy scan ERMS 3.1 Authentication challenge 5. Db logs event 5.1 Proxy server logs the event 6. Data Farm ALCTS Summer 2005 Schematic View of the Data Logging Process

6. Borrow a Video Customers Inform Access an E-journal Staff Staff Catalog a Book Visit a Library Copy or Print Data Streams Clean | Anonymize | Integrate Data Farm Environment People and Network Data ALCTS Summer 2005 Data Farm Project: Events, Data, Plumbing, Information Service Events

7. E-Resource Use Resolve Resource Resolve People Resolve Places Digital Library (erms) Print Library (Voyager) Building Use Staff Census Reference|Instruction (dynamic) Metadata LDAP Administration ALCTS Summer 2005 Data Farm Oracle Space: 14+ gb, in 75 tables, tracking events and their properties Circulation Reference Contact Web Analytics Acquisitiions Funds Image Collection Use Holdings Tech Processing Workflow Copier | Printer Use Gate Swipes

8. Dashboard Reports (static) Report Builders (dynamic) Data Bureau (ad hoc reports and fishing expeditions) ALCTS Summer 2005 So, what do we do with the data? Provide a distributed and multi-tiered environment for interacting with raw data and generating quantitative information Lower barriers between management information and people with management responsibility (or any other staff) Help to scale and institutionalize assessment

9. ALCTS Summer 2005 INTERACTIONS with DATA Dashboards: Vital signs at a glance

10. ALCTS Summer 2005 INTERACTIONS with DATA Report Builders

11. ALCTS Summer 2005 Attempts at ranking for selection based on use and other factors

12. ALCTS Summer 2005 A Hypothetical Scheme for Journal Selection Ranking Qualitative Scores Quantitative Scores Factor Rank Librarian rank Impact Penn Artcls. Use Metric Cost Effc Title 1 1 2.60 1 3 4 -1.54 1 Title 2 1 3.87 6 4 54 -1.72 2 Title 3 3 22.4 9 9 8 -1.89 3 Title n

13. Distribution of E-resource Use Across the Libraries FY04 Logins Pct. Cml Pct. Van Pelt (public areas) 174,584 55.2% 55.2% Biomedical (public areas) 41,577 13.2% 68.4% Staff (Van Pelt-Dietrich and Biomedical) 41,356 13.1% 81.5% Electronic Classroom 14,535 04.6% 86.1% Fine Arts 13,671 04.3% 90.4% Lippincott 10,293 03.3% 93.6% Veterinary 5,708 01.8% 95.4% Dental 4,304 01.4% 96.8% Museum 3,598 01.1% 97.9% Chemistry 1,950 00.6% 98.6% Math 1,901 00.6% 99.2% Undergraduate Study Ctr 1,502 00.5% 99.6% Rare Book and Manuscript 954 00.3% 99.9% High Density Storage 209 00.1% 100.% Total Libraries 316,140 100% ALCTS Summer 2005 INTERACTIONS with DATA Ad Hoc | Mediated

14. ALCTS | Summer 2005 Ad Hoc Interactions with the Database Items Charged and E-resource Log-ins Fall 2004

15. ALCTS | Summer 2005 Relationship Between E-Resource Use and Item Circulation, Fall 2004 72 observations

16. ALCTS Summer 2005 Practical Applications of Data Farm Resources Budget defense (slow but steady rates of increase, curtailing the need to make major cuts in materials) Print collection management E-resource selection (driving trade-offs more typically than cuts) Staffing | Facilities Planning Developing and testing web tools Feeding the data-mavens and spreading best practices

17. ALCTS Summer 2005 Key Attributes of Metrics and Measurement Processes [REPRISED] Metrics Comprehensive [Licensed Stuff, Local, Public] Consistent [Uniform Across Resources, Replicable] Context-Sensitive [Location, Time, Demographic, Cost, Resource Type & Class, Need] Processes-Data Granular, Normalized, Integrative, Anonymous Processes-Architecture Scaleable, Efficient (high output for low effort), Sustainable, Distributed

18. E-Use Measurement: A Detour Around the Publishers Joe Zucca zucca@pobox.upenn.edu University of Pennsylvania Library

19. ALCTS | Summer 2005 ScienceDirect Journals:Regression of View Counts (Elsevier) on Penn Login Counts. Feb-Nov 2003. [1,270 cases]

20. 1800 2 R = 0.9814 1600 1400 1200 1000 800 OCLC Login Count 600 400 200 0 0 500 1000 1500 2000 Penn Login Count [count-use] ALCTS | Summer 2005 OCLC Databases:Regression of Vendor Login Counts on Penn Login Counts, jl2001-je2002. [48 cases]

21. ALCTS | Summer 2005 Three E-Use Profiles by Residence: Top Ten Titles Used Logins per Capita, Feb ‘03-May ‘05

22. ALCTS | Summer 2005 Three E-Use Profiles by Residence: Top 15 Titles Used (by login count)