1 / 12

UKOLN is supported by:

Pitfalls and blind alleys: perspectives on quality measures Ann Chapman Interoperability Focus. UKOLN is supported by:. Quality measurement. Accuracy – is the data correct? Consistency – is the data consistent? Functional – does the data support users?

monet
Download Presentation

UKOLN is supported by:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pitfalls and blind alleys: perspectives on quality measures Ann Chapman Interoperability Focus UKOLN is supported by:

  2. Quality measurement • Accuracy – is the data correct? • Consistency – is the data consistent? • Functional – does the data support users? • Currency – is data available when needed

  3. Measuring tape or string? • Surveys • Sampling frame, sample sizes • What is being surveyed? • Questionnaires • Leading questions, response scales • User perceptions • Toolkits • Limitations

  4. Survey samples • Sample sizes • Minimum 100 (BNB 1440 over a year) • Split samples, bigger overall sample • Sampling frame • Public and academic libraries • Staff and students • Subject areas

  5. Quality = type of record • BNB Currency Survey 1980 – 2005 • Hit split into record types • Full record from BL • Formerly CIP • CIP • Assume records found are correct • Sometimes spot error

  6. Errors in data • LDLSCP Audit 1994 – • 100 records BL, 9 each LD library • Checklist of error types • 008/260 don’t match, spelling, indicators, added entries, consistent data in related records • Limited by not seeing items

  7. Edits = errors • BLCMP (Talis) study 1992-1993 • % of records edited • Analysis of 1310 paired ‘before/after’ records – but no verification of need to edit • Member libraries submitted a small set of records edited and gave their reasons for editing

  8. Quality = user understanding • Cambridge University Study 1992 • 300 interviews • Random (91 UG, 209 PG/staff) • Users not grouped by area of study • Main problems found • Misunderstanding data (jargon) • Difficulty with OPAC labels • Misinterpreting abbreviations

  9. Decide on parameters • Cat-Assess Tool (1999-2001) • Record cataloguing policies first • Random sample ‘book/record’ check • BNB Currency Survey • BNB Exclusions policy • LDLSCP Audit • Assessment limited by not seeing item • To assess consistency, some related records must be in sample

  10. Re-using data • BNB Currency Survey • Acquisitions trends over time • Retention of stock • Comparison with other record suppliers (1996-1999) • Monitor effect of BL policies

  11. So remember … • What do you want to measure? • Do you already collect data you can use? • If not, choose an appropriate method of data collection • Write up methodology and results, especially for repeated studies

  12. UKOLN Visit the UKOLN website at: http://www.ukoln.ac.uk/ Bibliographic Management http://www.ukoln.ac.uk/bib-man/ Collection Description Focus http://www.ukoln.ac.uk/cd-focus/

More Related