120 likes | 302 Views
Today. Review midterm exams Subject directories handout Precision & recall Demonstration of Google Scholar & LibX Peer review, citation searching, evidence-based practice Course Journal review. Precision & Recall.
E N D
Today Review midterm exams Subject directories handout Precision & recall Demonstration of Google Scholar & LibX Peer review, citation searching, evidence-based practice Course Journal review
Precision & Recall Relevancy: the likelihood or probability that a search result (i.e. “a hit”) meets the user’s expected information need; the result fulfills or partially satisfies the need or answers the question at hand Precision: the ratio of retrieved documents (or a pre-defined subset) that are relevant, contraposed to those that are irrelevant Recall: the portion of the total number (or a pre-defined subset) of relevant documents that are successfully retrieved There is a trade-off between precision and recall. Greater precision decreases recall and greater recall leads to decreased precision
Precision and Recall RelevantNot Relevant Retrieved: true positive (tp) true negative(tn) Not-Retrieved: false negative (fn) false positive (fp) Either you can obtain very accurate results or you can find many results which have some connection with the search query There is a trade-off between precision and recall. Greater precision decreases recall and greater recall leads to decreased precision Source: http://www.seothegame.com/precision-recall-and-the-f-measure-1442
Precision & Recall Relevancy: the likelihood or probability that a search result (i.e. “a hit”) meets the user’s expected information need; the result fulfills or partially satisfies the need or answers the question at hand Precision: the ratio of retrieved documents (or a pre-defined subset) that are relevant, contraposed to those that are irrelevant Recall: the portion of the total number (or a pre-defined subset) of relevant documents that are successfully retrieved There is a trade-off between precision and recall. Greater precision decreases recall and greater recall leads to decreased precision
Today Review midterm exams Subject directories Precision & recall Demonstration of Google Scholar & LibX Peer review, citation searching, evidence-based practice Course Journal review
Cited Reference Searching Citation index: an index of citations between publications, allowing the user to easily navigate from cited document to citing document, and vice versa
Cited Reference Searching Two major problems with current systems: Incorrectly processed machine indexed citations, often due to improperly cited references in the source document Domain limitations across publishing platforms and publishers’ content
Cited Reference Searching Three types of cited reference searching (Jasco, 2004): Full-text databases: Google; does not distinguish between author of citing article and authors of cited articles Cited reference indexes: used primarily by indexers of particular publishers or journals Field specific index: Web of Science; provides search fields for cited author, publication, etc.
Peer Review System of review established to insure quality and credibility in scientific publishing Blind and double blind The only way to know for sure if a journal is peer reviewed is to look at the journal editorial or review policy Not perfect, the peer review process is constantly undergoing its own evaluation in order to increase reliability and decrease corruption
Problems with Peer Review System Lack of raw data needed to verify claims made in manuscript submissions Conflicts of interests Slow Competition between authors and reviewers
Evidence-based Practice/Research “the conscientious, explicit and judicious use of current best evidence in making decisions about the care of the individual patient. It means integrating individual clinical expertise with the best available external clinical evidence from systematic research.” (Sackett, 1996) Evidence-Based Practice requires that clinicians search the literature to find answers to their clinical questions. http://guides.mclibrary.duke.edu/content.php?pid=431451&sid=3529499
“Once statistical errors are published, it is hard to stop them from spreading and being cited uncritically by others.” (Altman, 2002)