340 likes | 404 Views
Olin Library Reference Statistics Reporting System. COM S 501 Team: Ron DeVera Matt Kulick Annie Lin Kavitha Nair Soutrik Pramanik Krystal Wang Kevin Wong. Presentation Topics. Presentation Topics System Design System Demo User Testing Updated Schedule & Milestones Questions.
E N D
Olin Library Reference Statistics Reporting System COM S 501 Team: Ron DeVera Matt Kulick Annie Lin Kavitha Nair Soutrik Pramanik Krystal Wang Kevin Wong
Presentation Topics Presentation Topics System Design System Demo User Testing Updated Schedule & Milestones Questions • Progress Update • System Design • System Demo • User Testing • Schedules & Milestones • Questions
System Demo Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
User Testing Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • Motivation • Methodology • Results • Feedback we’re addressing • Negotiable Feedback
Motivation • Why we’re user testing: • Feasibility analysis, emphasized “ease of use” • Stakeholders with differing technical backgrounds • Adoption and success hinge upon successful replacement of complicated paper-based solution • Data-intensive requirements, powerful and thought-out UI Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Motivation • Why we’re user testing: • Our clients will be using the system, not us! • Evaluate our understanding of expectations • Promote process visibility – What we’ve accomplished • Generates helpful feedback from different perspective Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Methodology • How we’re user testing: • One-on-one, 30-45 min user tests with staff levels • Specific tasks to complete • No prior demonstration or training • Pre-planned questions designed to stimulate feedback • Emphasis on testing system, not the stakeholder! • Standardized tasks / questions among all testers Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Methodology How we’re user testing: Example User tasks included: - Logging In - Saving new reference questions - Editing reference questions - Searching / Exporting questions - Deleting record(s) - Using Keyboard Shortcuts Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Methodology How we’re user testing: Example Administrator tasks included: - Exporting search results - Generating weekly report - Changing passwords - Adding, changing labels, categories - Adding locations Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Methodology • How we’re user testing: • Types of questions we asked: • Which labels,keywords were confusing? • What was the hardest task? • What did you like, that should not be changed? • If you were us, what would you change? • How does this system compare to your paper based system • How useful do you find the new report layout? (admin) • Do you have any other comments or questions about the system? (open ended) Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #1, Search Form Confusion! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #2, Inconspicuous Edit/ Confirmations! Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #3, Confirmation Terms Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #4, Entry Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: Issue #4, Entry Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing What we’ve found: #5, Search Results Disambiguation & Semantics Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Results, Addressing Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • What we’ve found: Other Issues • Scrollbar annoyances • Alt-O “Press Alt-o to Log Out” • Ability to press 1 button to export all • More / Better Confirmations • Search interface needs to be overhauled
Results, Negotiable Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions • What we’ve found: Negotiable concerns • Some prefer dropdowns, some prefer checkboxes • Some would prefer “2-D matrix” of buttons, a virtual paper entry sheet (input form matches current system exactly) • “Break-up Editing” of multiple reference question entries
Updated Schedule & Milestones Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Where we are in: Functionality Schedule Milestones
Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface login { 100% } data entry { 100% } searching - search by notes field - redesign - debugging
Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface exporting - “export all” - remove debugging output - testing
Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions User Interface admin - backup - site & system options - add / change user types - interface with report generation
Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Reports remaining: - dynamic report generation - database integration (basically coding)
Functionality Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Database (100%) All data structures are working Errors are logged into a separate table
Schedule Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions
Future Milestones Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Next Iteration - full functionality on all subsystems - report generation - interface redesign - further user testing, for redesign assurance
Presentation Topics System Design System Demo User Testing Schedule & Milestones Questions Questions?