1 / 36

Quality Modeling Digital Libraries Foundations Workshop at JCDL 2007 Vancouver – June 23

Quality Modeling Digital Libraries Foundations Workshop at JCDL 2007 Vancouver – June 23. Edward A. Fox Virginia Tech, USA fox@vt.edu http://fox.cs.vt.edu. Acknowledgements: Students.

meara
Download Presentation

Quality Modeling Digital Libraries Foundations Workshop at JCDL 2007 Vancouver – June 23

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Quality ModelingDigital Libraries FoundationsWorkshop at JCDL 2007Vancouver – June 23 Edward A. Fox Virginia Tech, USA fox@vt.edu http://fox.cs.vt.edu

  2. Acknowledgements: Students • Ghaleb Abdulla, Robert France, Marcos Gonçalves, Doug Gorton, Rohit Kelapure, Neill Kipp, Aaron Krowne, Yi Ma, Paul Mather, Uma Murthy, Ananth Raghavan, Unni. Ravindranathan, Ryan Richardson, Rao Shen, Ricardo da Silva Torres, Srinivas Vemuri, Seungwon Yang, Qinwei Zhu, …

  3. Acknowledgements: Faculty, Staff • Lillian Cassel, Lois Delcambre, Debra Dudley, Joanne Eustis, Weiguo Fan, James Flanagan, Sandy Grant, Eric Hallerman, Douglas Knight, Alberto Laender, David Maier, Manuel Perez-Quinones, Layne Watson, …

  4. Other Collaborators (Selected) • Brazil: FUA, UFMG, UNICAMP • Case Western Reserve University • DELOS and its many members • Emory • Germany: Univ. Oldenburg • Portland State University

  5. Acknowledgements: Support ACM, AOL, CAPES, CNI, DFG, IBM, IMLS, Microsoft, NDLTD, NLM, NSF (IIS-9986089, 0080748, 0086227, 0307867, 0325579, 0535057, 0535060; ITR-0325579; DUE-0121679, 0121741, 0136690, 0333531, 0333601, 0435059, 0532825, …), SUN, …

  6. Quality • Big picture • Quality of union DLs • 5SQual • Prior Work on Measuring DL Success • IT/ IS success/adoption • DL success model • DL success, info, seeking/utilization

  7. Quality Big Picture • Purpose, Goals, Objectives • Advancing scholarship/civilization, Communication, Sharing/use, Open access/preservation, … • Perspectives, Observations • User/patron/personal, organizational, community • System Performance • Metrics, Measurements • Models • Analysis, Reporting • Continuous Improvement (logging -> enhancement) • See also next talk for literature review

  8. Asynchronous, Digital Library Mediated (Scholarly) Communication Different time and/or place

  9. Digital LibrariesShorten the Chain from Author Editor Reviewer Publisher A&I Consolidator Library Reader

  10. To a flatter, service-oriented, more general framework Roles Digital Library Author Teacher User Reader Editor Learner Reviewer Librarian: designing, acquiring, organizing, collaborating, evaluating Machine Context in which the DL is embedded

  11. Quality dimensions and measurement for minimal union DLs

  12. 5S definitional structure

  13. Completeness • Conformance 5SQual - Dimensions • Accessibility • Similarity • Significance • Timeliness Digital Objects Metadata Numeric Indicators • Efficiency • Reliability Services

  14. 5SQual Archi-texture

  15. Evaluations – Charts

  16. Prior Work on Measuring DL Success inspection of NCSTRL Usability of DLs has an example evaluation of ACM, IEEE-CS, NCSTRL, and NDLTD evaluation of ADL evaluation of ADEPT Intention to re/use predict Technology acceptance model has an example Venkatesh system usage DeLone et al. has an indicator IS success model has an example Seddon Ellis Information seeking behavior model has an example Kuhlthau DL quality model has an example Gonçalves

  17. intention to use system performance expectancy system usage effort expectancy social influence facilitating conditions Behavioral Attitude & Intension to Use— Venkatesh Model of IT Adoption Unified Theory of Acceptance and Use of Technology

  18. Venkatesh Model of IT Adoption • Performance expectancy: • perceived usefulness, extrinsic motivation, job-fit, relative advantage, and outcome expectations • Effort expectancy • the degree of ease associated with the use of system • Social influence • Subjective norms, social factors, and image • Facilitating conditions • the degree to which an individual believes that an organizational and technical infrastructure exist to support the system

  19. DeLone and McLean Model of IS Success System Quality Use Individual Impact Organization Impact Information Quality User Satisfaction

  20. Seddon Model of IS Success Net Benefits to: Individuals Organizations Society System Quality Perceived Usefulness Information Quality User Satisfactions

  21. DL Success Model • 5S and minimal DL • Synthesize • IS success and adoption models (see above) • Information life cycle model (Borgman et al.) • 5S-based DL quality model (Gonçalves et al.) • Information-seeking behavior models (Ellis’ and Kuhlthau’s) • From end user perspective

  22. Information Life Cycle Creation Active Authoring Modifying Social Context Using Creating Organizing Indexing Retention / Mining Accessing Filtering Storing Retrieving Semi- Active Utilization Distributing Networking Inactive Searching

  23. searching, browsing, recommending accessing, filtering completeness, conformance accuracy, Active accessibility, preservability Semi-active preservability, authoring, modifying, describing organizing, indexing storing, archiving, networking similarity, timeliness, creation distribution utilization seeking pertinence, significance, relevance Gonçalves et al. accessibility, Inactive timeliness

  24. E1:starting K1: initiation K6: presentation E2: chaining E3: browsing E4: differentiating E5: monitoring E6: extracting K2: selection K5: collection K3: exploration K4: formulation E: Ellis’ model K: Kuhlthau’s model completeness, conformance accuracy, Active accessibility, preservability Semi-active preservability, authoring, modifying, describing organizing, indexing storing, archiving, networking similarity, timeliness, creation distribution utilization seeking Inactive DL Success Constructs

  25. relevance adequacy timeliness reliability understandability scope ease of use accessibility user interface joy of use reliability DL Success Model information quality (IQ) information quality (IQ) performance expectancy (PE) behavioral Intention to (re)use satisfaction system quality (SQ) social influence (SI)

  26. collection metadata catalog digital object metadata specification repository DL Concepts Regarding Information associated with consist of consist of associated with consist of

  27. Digital Library IQ digital object accessibility understandability preservability relevance pertinence timeliness relevance reliability similarity adequacy significance timeliness metadata specification accuracy completeness conformance collection completeness impact factor completeness catalog consistency completeness repository consistency Information Quality (IQ) digital object metadata specification catalog collection adequacy repository scope

  28. service accessibility composability reliability reusability ease of use extensibility joy of use efficiency effectiveness reliability screen design navigation Digital Library SQ System Quality (SQ) performance expectancy user interface

  29. DL Success Constructs Associated with Seeking and Utilization Phases

  30. DL Success Constructs Associated with Seeking Phase • E1: Starting’ activity in Ellis’ model (K1: ‘initiation’ stage in Kuhlthau’s model) • Social Influence (SI) — DL visibility • Publicize existence of a DL • Provide a DL alert service

  31. DL Success ConstructsAssociated with Seeking Phase • E2-E6: ‘chaining’, ‘browsing’, ‘differentiating’, ‘monitoring’, and ‘extracting’ in Ellis’ model (K2-K3: ‘selection’ and ‘exploration’ stages in Kuhlthau’s model) • Information Quality (IQ) • System Quality (SQ) • Performance Expectancy (PE)

  32. DL Success Constructs Associated with Utilization Phase • K4-K6: ‘formulation’, ‘collection’, and ‘presentation’ stage in Kuhlthau’s model • Information Quality • information accuracy • information accessibility

  33. Summary: Quality • Big picture • Quality of union DLs • 5SQual • Prior Work on Measuring DL Success • IT/ IS success/adoption • DL success model • DL success, info, seeking/utilization

  34. Summary: Quality Big Picture • Purpose, Goals, Objectives • Advancing scholarship/civilization, Communication, Sharing/use, Open access/preservation, … • Perspectives, Observations • User/patron/personal, organizational, community • System Performance • Metrics, Measurements • Models • Analysis, Reporting • Continuous Improvement (logging -> enhancement) • See also next talk for literature review

  35. Discussion

More Related