1 / 17

Usability, the User Experience & Interface Design:

Usability, the User Experience & Interface Design: . The Role of Reference. July 30, 2013. Evaluating user behaviors and experiences . Summon discovery service at Virginia Tech. By Tracy Gilmore & Lesley Moyo. Introduction. Continual assessment necessary in providing proactive user support

kineta
Download Presentation

Usability, the User Experience & Interface Design:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Usability, the User Experience & Interface Design: The Role of Reference July 30, 2013

  2. Evaluating user behaviors and experiences Summon discovery service at Virginia Tech By Tracy Gilmore & Lesley Moyo

  3. Introduction • Continual assessment necessary in providing proactive user support • At Virginia Tech we endeavor to gather data on user behaviors every spring • Study of user experiences with discovery services is our current focus • Summon is our choice of Web scale discovery services

  4. Collecting Data and Observing Behaviors • Virginia Tech has adopted a mixed methods approach to studying user research behaviors • Surveys • Focus Groups & One-on-one interviews • Usability task analysis • This helps triangulate the data and gives us grounds for making strong inferences

  5. Unveiling the Data • Using a robust survey tool is very helpful • We used Qualtrics Research Suite: www.qualtrics.com • Qualtrics offers strong data analysis features • We crunched some of the survey data using SPSS to get more detailed analysis • NVIVO for analysis of interviews and focus group data

  6. What we learned about user behavior and preferences

  7. Survey Results – User Preferences Preference for Summon: • Stronger than Google Scholar • Stronger than the Library Catalog User Preference - 2012 User Preference - 2013 Easy to use Moderately easy to use Neither easy nor difficult Moderately difficult use Difficult to use High preference Moderate preference Neither high nor low preference Somewhat low preference Low preference

  8. 2012 Survey results - Predictors of satisfaction Ease of use & Satisfaction Facets use & Satisfaction Top ranked journals & Satisfaction

  9. 2013 Survey results - Predictors of satisfaction Ease of use & Satisfaction Facets use & Satisfaction Top ranked journals & Satisfaction

  10. User voices - Open ended questions Comments 2012 Comments 2013 The faceted searching (I didn’t know it was called that) is absolutely essential Ability to get many different types of sources with one search I found it to be more helpful when looking for books than articles Even with facets, Summon casts too broad a net for my needs • I like that I only have to search in one place • On several occasions Summon has found some good papers that Google Scholar didn't • Summon is great if I know the article I’m looking for • I need more skill at searching • I get so many hits that are not useful

  11. User voices - Interviews/Focus groups Comments Suggestions Provide direct linking to articles Provide more instruction on how to use Summon: Using facets Using Subject Terms • Summon is easy to use • Facets are a great tool • Too many results! • Boolean operators please • Training would be nice

  12. Task Analysis observations Strengths Challenges Page navigation Evident lack of familiarity with Summon features Large result sets still an issue Mixed success rates in task performance Get VText (360 link resolver) • Good results achieved with advanced search • Some participants able to effectively use facets • Effective use of quotations for known items

  13. Enter librarian perspectives • In spring 2013 - We included librarian voices • This provided us with comparative perspectives • How do we as librarians interpret user behaviors, given our own biases of what research processes should look like?

  14. Librarian voices More students use it as a starting place, so when troubleshooting that's what's involved more often than not Summon has been especially helpful with interdisciplinary topics even in identifying specific databases to more fully explore Fast way of gathering extensive information and familiar to the "Google generation” I am a very happy user of Summon. The interface, the single user box, and the facets are intuitive and easy to use

  15. Changes implemented from findings • Better integration in the instruction program especially at the freshman level • Improvements to the interface - better direct linking to full text • Increase in the content index - emphasis on eBooks and reference sources • Better visibility on the Library homepage

  16. Going forward - Continuing assessment and evaluation • Implementation of Summon 2.0 (anticipated fall 2013) • Analysis of usage statistics from Google Analytics added to Summon in November 2012 • Expansion of Mixed Methods study to academic research libraries utilizing the Summon discovery service (fall 2013)

  17. Contact information Tracy Gilmore Collections Assessment Librarian University Libraries Virginia Tech 560 Drillfield Drive Blacksburg, VA  24061 Tel: 540-231-4956 Mobile: 540-239-4384 E-mail: tgilmore@vt.edu Library Web: www.lib.vt.edu Lesley Moyo Director for Research & Instructional Services University Libraries Virginia Tech 560 Drillfield Drive Blacksburg, VA  24061 Tel: 540-231-2708 Mobile: 814-777-7565 E-mail: moyo@vt.edu Library Web: www.lib.vt.edu

More Related