190 likes | 200 Views
This workshop, led by Martha Kyrillidou from ARL, delves into using E-Metrics to measure the impact of research libraries on education, research, and community. Participants explore new data elements, survey customization, and the MINES methodology for electronic resource usage tracking. Dive into the future of library performance metrics!
E N D
StatsQUAL™ Webmetrics Workshop Martha Kyrillidou Director, ARL Statistics and Measurement Program Association of Research Libraries American Library Association Chicago, IL June 24, 2004 www.statsqual.org
ARL Roles www.statsqual.org
ARL Statistics and Measurement …To describe and measure the performance of research libraries and their contribution to teaching, research, scholarship and community service … www.statsqual.org
Web Presence www.statsqual.org
Future of New Measures Initiative • Incorporation of some new data elements in traditional surveys • Development of workshops and consulting services for performance measures • Establishment of data gathering and statistical analysis tools www.statsqual.org
What do we mean by E-Metrics within ARL? • DigiQUAL • MINES for Libraries • ARL Supplementary Statistics • Project COUNTER www.statsqual.org
It’s…? “familiar” and digital www.statsqual.org
Developing DigiQUAL Survey Items • Background: ServQUAL ->LibQUAL ->DigiQUAL • LibQUAL dimensions of library service quality DigiQUAL: 12 themes of DL service quality www.statsqual.org
Building a Survey (cont.) CustomizeSurvey Issue: Flexibility vs. Standardization www.statsqual.org
Implementing Survey - Incentives Issues: must be easily transferable, requires email address - clear IRB www.statsqual.org
What is MINES for Libraries™ • MINES is a research methodology consisting of a web-based survey form and a sampling plan. • MINES measures who is using electronic resources, where users are located at the time of use, and their purpose of use. • MINES was adopted by the Association of Research Libraries (ARL) as part of the “New Measures” toolkit in May, 2003. • MINES is different from other electronic resource usage measures that quantify total usage (e.g., COUNTER, EQUINOX, E-Metrics, ICOLC Guidelines, ISO and NISO standards) or measure how well a library makes electronic resources accessible (LibQual+TM). www.statsqual.org
MINES for Libraries™ Methodology • A representative sampling plan, including sample size, is determined at the outset. Typically, there are 48 hours of surveying over 12 months at a medical library and 24 hours a year at a main library. • Random moment/web-based surveys are employed at each site. • Participation is usually mandatory, negating non-respondent bias, and is based on actual use in real-time. • Libraries with database-to-web gateways or proxy re-writers offer the most comprehensive networking solution for surveying all networked services users during survey periods. www.statsqual.org
What do we mean by E-Metrics within ARL? • DigiQUAL • MINES for Libraries • ARL Supplementary Statistics • Project COUNTER www.statsqual.org
Analysis & Reporting - Issues Interpreting results from individual libraries in the context of other sites www.statsqual.org