110 likes | 122 Views
DigiQUAL™. Developing the DigiQUAL Protocol for Digital Library Evaluation. Martha Kyrillidou, Director, Statistics & Measurement Program Sarah Giersch, Consultant Association of Research Libraries. ACM / IEEE 2005 Joint Conference on Digital Libraries Denver, Colorado, USA June 9, 2005.
E N D
DigiQUAL™ Developing the DigiQUAL Protocol forDigital Library Evaluation Martha Kyrillidou,Director, Statistics & Measurement Program Sarah Giersch,Consultant Association of Research Libraries ACM / IEEE 2005 Joint Conference on Digital Libraries Denver, Colorado, USA June 9, 2005 www.digiqual.org
Terminology & Context • It’s…? “familiar” and digital • National Science Digital Library - Evaluating the entity and Evaluating the projects • DigiQUAL: measure service quality in DLs www.digiqual.org
Developing DigiQUAL Survey Items • Background: ServQUAL ->LibQUAL ->DigiQUAL • LibQUAL dimensions of library service quality [would like to use a radar chart instead of text if there is space] DigiQUAL: 12 themes of DL service quality www.digiqual.org
Pilot Testing Survey Items & Implementation Your Digital Library? www.digiqual.org
Building a Survey • Review and select items • Issue: aligning items to individual DL needs and users – vocabulary & content www.digiqual.org
Building a Survey (cont.) CustomizeSurvey Issue: Flexibility vs. Standardization www.digiqual.org
Implementing Survey – Notification Methods • Links on site • Newsletters • Next to resources Issues: no pop-ups, no individual emails www.digiqual.org
Implementing Survey - Incentives Issues: must be easily transferable, requires email address - clear IRB www.digiqual.org
Analysis & Reporting - Issues Interpreting results from individual digital libraries in the context of other sites Sites reluctant to sharedata and results - possible negative impactwith users and funding agencies www.digiqual.org
Outstanding Issues & Challenges • Unique DLs: niche market, critical mass, both? • Balance: • custom vs. generic content ->results • flexible vs. standard implementation -> scaling • Mixed methods • Preserving user privacy • Collecting truly useful data • Moving target: digital libraries as… it depends www.digiqual.org
Next Steps • Continue pilot testing: NSDL and beyond • Expand implementation • Consider sustainability models • Want to Participate? Contact: • Sarah Gierschsgiersch@bellsouth.net • Martha Kyrillidoumartha@arl.org • For more info: • www.digiqual.org www.digiqual.org