150 likes | 260 Views
eEvidence : Information Seeking Support for Evidence-based Practice: An Implementation Case Study. Jin Zhao, Min-Yen Kan, Paula M. Procter, Siti Zubaidah , Wai Kin Yip, Goh Mien Li. Evidence-based Practice (EBP). Advantages Reliable, extensive and updated. Intervention A.
E N D
eEvidence: Information Seeking Support for Evidence-based Practice:An Implementation Case Study Jin Zhao, Min-Yen Kan, Paula M. Procter, SitiZubaidah, Wai Kin Yip, Goh Mien Li
Evidence-based Practice (EBP) • Advantages • Reliable, extensive and updated Intervention A ResearchArticles Intuition Intervention B Experience Intervention C WING, NUS
Two Stages of EBP Crucial yet difficult! • Stage 1: Search and Appraise • Stage 2: Apply and Evaluate Article Collections ResearchArticles Interventions Interventions WING, NUS
Issues in the Search & Appraise Stage • Accessibility problems • Collection-specific specialized search engines • Subscription barrier • Usability gap in Search Engines • Key information not displayed or searchable • Elements of well-form clinical questions • E.g., demographics of the patient, intervention and results • Strength of evidence • E.g., study design • Different search patterns • Active v.s. passive WING, NUS
eEvidence System for EBP • Key features • Harvesting EBP resources by periodic crawling • Address accessibility issue and ensures up-to-date coverage • Automated article classification and key information extraction • Provides crucial information to assist search and appraisal • Dual active/passive user interface • Caters for different search patterns WING, NUS
System Architecture EBPresources WING, NUS
Harvesting EBP Resources by Periodic Crawling • Two stages • Selection of EBP resources by experts • Periodic crawling using Nutch • Advantages • Able to harvest from any type of EBP resources • Always up-to-date WING, NUS
Automated Article Classification • Supervised machine learning pipeline • Three categories: full text / abstract / others • Maximum entropy classifier • Text, webpage and formatting features • Advantages • Filters out useless webpages • Allows users to zoom to subsets of articles WING, NUS
Automated Key Information Extraction • Year of publication, article type, time added, URL • Key sentence / keywords • Advantages • Provides crucial information to assist search and appraisal WING, NUS
Extraction of Key Sentences and Keywords • Cast as two-stage pipelined soft-classification Sex Keywords Patient Sentences Race Keywords Intervention Sentences Age Keywords Keyword classification Sentence Classification Result Sentences Sentences Condition Keywords Research Goal Sentences Intervention Keywords Study Design Sentences Study Design Keywords WING, NUS
Extraction of Key Sentences and Keywords • 1-against-all MaxEnt classifiers for each class based on various text features • Key Sentences Extraction • Precise but much room for improvement in recall • Due to the variety of sentence structure and the shortness of information • Acceptable in the context of Information Retrieval • Keywords Extraction • Good performance in general • Difficult to extract keywords belonging to classes with a diverse vocabulary or lexical variations Performance for key sentences extraction Performance for keywords extraction WING, NUS
Dual Interface (Read) • Recommend relevant articles based on user profile WING, NUS
Dual Interface (Search) • Allow users to search with complex query and filters • Search history in place of profile WING, NUS
Discussion • Iterative development methodology • Interview users for requirements • Design and implement features • Gather user feedbacks of the system • Current feedbacks • Able to find freely available full text articles • Search history useful for writing of search methodology • Collection size still limited for practical task • Future work • Improve key information extraction • Extend collection and perform full-fledge evaluation • Discover user- and group- specific features WING, NUS
Conclusion • eEvidence: a literature retrieval system with novel features to facilitate EBP • Harvesting EBP resources by periodic crawling • Automated article classification and key information extraction • Dual active/passive user interface WING, NUS