200 likes | 372 Views
Creating and Evaluating an Interactive Online Tutorial to Help Medical Students Locate Literature for Evidence-Based Medicine. Josephine Tan, MLIS Education and Information Consultant, Clinical Sciences tan@library.ucsf.edu October 17, 2006. Overview. Background Objective Methodology
E N D
Creating and Evaluating an Interactive Online Tutorial to Help Medical Students Locate Literature for Evidence-Based Medicine Josephine Tan, MLIS Education and Information Consultant, Clinical Sciences tan@library.ucsf.edu October 17, 2006
Overview • Background • Objective • Methodology • Results • Discussion • Conclusion
Background The Players • Third-year medical students (MS3) • Two faculty members • Librarians
Background The Way Things Were MS3’s meet for one week after completing their first clinical clerkship Faculty teaches a search algorithm to help students find EBM literature Clinical Decision Making lecture Librarians teach students how to apply this search algorithm during computer lab sessions After the lecture
Background What Was Taught Developed by the faculty Two clinical scenarios During these computer labs, librarians presented students with The Search Algorithm Using these cases, students learned to Formulate a clinical question Search PubMed Clinical Queries & RCT’s in PubMed Search the Cochrane Library
Background Why Things Changed • Students use an online evaluation tool to rate their lecture sessions during this one week • Student feedback for the past few years was consistently lower for the computer lab sessions • Students felt that the lab sessions were redundant
Background How Things Changed • Faculty approached the librarians • Suggested that an online tutorial be created • Replace the lab sessions by requiring students to take the online tutorial • Ask for student feedback
Objective Why the Idea Might Work • Students could self-pace their learning • Students would be more engaged with the search exercises • By creating this online tutorial, librarians would have a larger impact on student learning than they did during in-person sessions
Methodology How the Tutorial Was Created • Used authoring software Macromedia (Adobe) Captivate • Met twice in person with faculty • At beginning and end of project • Corresponded with faculty via email • Feedback during project development • Worked with the Office of Educational Technology • Web design assistance
Reminder The Way Things Were MS3’s meet for one week after completing their first clinical clerkship Faculty teaches a search algorithm to help students find EBM literature Clinical Decision Making lecture Librarians teach students how to apply this search algorithm during computer lab sessions After the lecture
Methodology What Happened This Year MS3’s meet for one week after completing their first clinical clerkship Faculty teaches a search algorithm to help students find EBM literature Clinical Decision Making lecture Librarian speaks to students about the online tutorial During the lecture Students take the online tutorial before the next day’s discussion group Students can attend an optional computer lab session that afternoon
The Fruits of Our Labor URL: http://missinglink.ucsf.edu/lm/EBM_litsearch/
Results Evaluation Results 2005 Data n=136 students 2006 Data n=154 students Likert scale: 1=poor 2=fair 3=good 4=very good 5=excellent No students attended the optional computer lab session
Results Summary of Student Feedback 12 students provided written feedback • 7 comments indicated that the tutorial was extremely helpful • 5 comments provided suggestions for improvement of the flow of information
Results Student Comments “Easy to use and extremely helpful. Only wish that it would have been presented earlier in med school.” “This is an excellent resource. Could it be made available sooner? This would be very helpful during first and second year.” “GREAT MODULE. Huge kudos to the woman who put it together. It was the most useful item of the week.”
Discussion Next Steps Speed up the narration pace of the tutorial Make the website layout more intuitive in how to navigate the tutorial Have a PDF on the site that summarizes all the search tips taught in the tutorial Determine whether or not this tutorial should be introduced to students earlier in their academic year
Discussion Lessons Learned • How to improve the flow of the tutorial information based upon student feedback • Begin communicating early and often with faculty to develop and finalize the details of clinical cases • Having a librarian speak to the students during their lecture emphasizes to students the purpose and importance of taking this tutorial
Conclusion What We Learned An online tutorial is an effective way for students to learn EBM literature searching skills Similar online tutorials can be developed by collaborating with other medical faculty For an example, visit: http://missinglink.ucsf.edu/lm/EEBM/ [this tutorial debuted for a MS-2 class on Oct. 2, 2006]
Authors & Acknowledgements • Josephine P.G. Tan, MLIS, UCSF Library • Keir Reavie, MLIS, UCSF Library • George Sawaya, MD, Department of Obstetrics, Gynecology and Reproductive Sciences • Eva Aagaard, MD, Department of Internal Medicine • Office of Educational Technology, School of Medicine • Center for Instructional Technology, UCSF Library