1 / 22

Evaluating eERL Chris Neuhaus 5-2003

Evaluating eERL Chris Neuhaus 5-2003. Digital Library Evaluation there are. Many Choices 1, 2, 3, … ! Many MANY Choices 10, 20, 30, … !! … but are there many … or are there any Good Choices? 1, 2, 3, … ?. What to Evaluate?. Target Populations eERL (ATEEL) .

lulu
Download Presentation

Evaluating eERL Chris Neuhaus 5-2003

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Evaluating eERLChris Neuhaus5-2003

  2. Digital Library Evaluationthere are • Many Choices 1, 2, 3, … ! • Many MANY Choices 10, 20, 30, … !! • … but are there many … or are there any Good Choices? 1, 2, 3, … ?

  3. What to Evaluate? • Target Populations • eERL (ATEEL)

  4. Needs Analysis Survey of Research Preferences What types of information do you need to do your research/job? Where do you look for your information? Target Population Survey

  5. Survey of Computer Skills Survey of Research Behavior How do you use your computer? How do you use the Internet? How do you find or gather your information? Target Population Survey

  6. eERL-ATEEL Assessment • Accessibility Can all eERL materials be accessed by all intended users?Those with visual disabilities?Authentication?

  7. eERL-ATEEL Assessment • Content Analysis • Quantity of Content Currency% live links # of items % of unique info • Quality of Content?

  8. eERL-ATEEL Assessment • Cost Dollars Spent Time Spent per # of items in library per visit to library

  9. eERL-ATEEL Assessment • Navigability Test Target Population Find a pre-selected item timed number of steps

  10. eERL-ATEEL Assessment • Navigability Search Engine Performance Yield Relevance Rated by Target Population Compared with other search engines – mechanically.

  11. eERL-ATEEL Assessment • Patterns of Use % of Target Population Visiting eERL more than once.

  12. eERL-ATEEL Assessment • Patterns of Use Compare use of eERL to use of established online resources at target institutions e.g. @ EICC compare the # of visits to eERL vs. # of visits to other Environmental Science Databases

  13. eERL-ATEEL Assessment • Patterns of Use Subjects from the Target Population interviewed – compare eERL to other Environmental Science Databases

  14. eERL-ATEEL Assessment • Promotion & Marketing # of e-mails sent to Target Population # of citations in Env. Sci. Literature # of times eERL appears in Search Engines

  15. eERL-ATEEL Assessment • Survey of eERL Awareness # of appearances on Env. Sci. faculty web pages # of faculty using eERL in their classes % or # of libraries pointing to eERL

  16. Outcomes Assessment • eERL Outcomes • Student Outcomes

  17. Outcomes Assessment • eERL Outcomes Measure (how?) the degree to which the objectives of eERL are met.

  18. Outcomes Assessment • Student Outcomes Give pre and post tests to students on the use of eERL Give pre and post tests to students on objectives facilitated by eERL use.

  19. Challenges Ahead! • Identifying Target Populations Especially Target Populations willing to participate in surveys and interviews

  20. Challenges Ahead! • Reaching the Willing Participants Surveys online Direct surveys Interviews

  21. Challenges Ahead! • What to Ask and What to Measure • Human Subjects Testing – Waivers • Record Keeping • Compiling the Results

  22. To Be Continued! • http://www.uni.edu/neuhaus/digitalwork.html • http://www.uni.edu/neuhaus/eerlwork.html • http://www.uni.edu/neuhaus/digitalbibeval.html • http://www.uni.edu/neuhaus/digitalcontacts.html

More Related