1 / 14

An analysis of evaluation activities planned in NN/LM outreach subcontracts 2001-2006

An analysis of evaluation activities planned in NN/LM outreach subcontracts 2001-2006. Mellanye Lackey 2 nd year Associate Fellow National Library of Medicine UNC-Chapel Hill Health Sciences Library mjlackey@email.unc.edu. What I’ll talk about today. Gaining background knowledge

jonny
Download Presentation

An analysis of evaluation activities planned in NN/LM outreach subcontracts 2001-2006

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An analysis of evaluation activities planned in NN/LM outreach subcontracts 2001-2006 Mellanye Lackey 2nd year Associate Fellow National Library of Medicine UNC-Chapel Hill Health Sciences Library mjlackey@email.unc.edu

  2. What I’ll talk about today • Gaining background knowledge • Literature review and conversations w. experts • Barriers • Project data • Collection methods • Analysis • Results and graphs • Opportunities to learn more

  3. Prior experiences usefulness motive fear negative results Getting buy-in relationships cooperation from partners support from authority appreciation of evaluation Lack of time money knowledge about evaluation processes Barriers to doing outreach evaluation -Taut, S. M., & Alkin, M. C. (2003). Program staff perceptions of barriers to evaluation implementation. American Journal of Evaluation. 24, 213-226.

  4. Data gathering

  5. Collecting project data Projects included • Public Health Information Model • Access to Electronic Health Information Subcontract • Consumer Health Initiative Subcontract • Resource Library Outreach Subcontract • Health Professional Information Outreach

  6. Project data • Funding from $2,000 to $70,000 reporting evaluation plan • Reviewed >500 records (1/2 of all NN/LM projects) • n = 144

  7. Data collection Methods QuestionnaireTally/LogPre/Post dataInterview/AnecdoteEvaluation formFocus groupObservation/Usability study Approaches Evidence for future useInternal committeeNeeds assessmentSocial capitalCase study

  8. 77 61 37 29 19 16 8 2 27 18 4 2

  9. $2500-$50,019 $2000-$56,000 $3200-$50,000 $17,973 $40,000 $2500-$50,000

  10. Records created at project inception Data sometimes rich, more often brief How many participants? Focus groups? How much time? Terms vague (eg. evaluation form) Growing emphasis on evaluation with Outreach Evaluation Resource Center (OERC) Limits of the data

  11. Further research ideas • Compare evaluation planned with final report • Get more specifics about each plan • Examine formative vs. summative • Collect information about “approaches” • How get more data?

  12. Conclusions • At all funding levels: • Intent to evaluate • Variety of methods • Opportunities to learn more • Bibliography of resources http://www.hsl.unc.edu/AboutLib/Staff/LiaisonWebPages/PHliaison.cfm • Outreach Evaluation Resource Center http://nnlm.gov/evaluation/index.html

More Related