1 / 21

Jo Hunter Clinical Outreach Librarian University of Oxford Health Care Libraries

This session aims to define critical appraisal, discuss its importance, and discover how to incorporate it in research and practice. It explores factors that determine the quality of research studies and provides examples of appraisal checklists. Participants will also learn how to set up a journal club and find relevant papers using scenario-based searching.

harrietr
Download Presentation

Jo Hunter Clinical Outreach Librarian University of Oxford Health Care Libraries

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction to Critical Appraisal Jo Hunter Clinical Outreach Librarian University of Oxford Health Care Libraries

  2. Aims of this session Define “critical appraisal” Discuss why it is important Discover how to incorporate it in your own research/practice

  3. Is this evidence good enough?

  4. What is “good” evidence? • We need to use evidence from research studies to support our arguments or decisions • How do we recognise a good quality research study?

  5. How can you tell whether a research study is “good quality”?

  6. Extrinsic factors: Journal Author Institution Quoted by other authors Quoted in newspapers Intrinsic factors: Study design Number of subjects Confounders Bias (author, experimental) Factors that tell you about the quality of a study include…

  7. Critical appraisal looks at the intrinsic factors “Critical appraisal is the process of systematically examining research evidence to assess its validity, reliability and relevance before using it to inform a decision.” (Adapted from Hill H & Spittlehouse C, EBM 2001; 3:2)

  8. Validity, reliability, relevance • Validity: To what extent is the study a close representation of the “truth”? • Reliability: Are the results credible and repeatable? • Relevance: Will the results help me in my own research or practice?

  9. Pros of critical appraisal • Systematic way of assessing a paper’s validity, reliability, relevance • Helps to close the gap between research and practice • Encourages objective assessment • Skills are not difficult – common sense & user-friendly checklists

  10. Cons of critical appraisal • Can be time-consuming initially • Does not always provide the “easy” answer – may provide more questions • Can be dispiriting if it highlights poor quality studies

  11. Examples of appraisal checklists • CASP for experimental studies, systematic reviews • DISCERN for consumer health information (papers about treatment choices • CriSTAL for librarianship studies (information needs analysis, user survey)

  12. Getting started 1) Set up a journal club 2) Remember/devise a suitable scenario 3) Find a relevant paper 4) Choose an appropriate checklist

  13. 1) Why set up a journal club? • Regular protected time for honing your “quality-detector” skills • Facilitates discussing and evaluating new research and its application to your research or practice • Helps to unravel complex problems

  14. 1) Five steps to journal club success • Identify a leader • Identify the goals of the club • Set up a regular meeting time • Send the scenario and paper to everyone before the meeting • Encourage active participation by using a checklist

  15. 2) Why bother with a scenario? • Provides a practical focus • Helps you to answer the applicability question • Helps you to find a paper

  16. 2) Example of a scenario A 32 year old man is found in garage with engine running. He is brought to the ED by paramedics. He is awake and alert. He complains of a headache. His exam is unremarkable. Skin colour is normal. Neurologic exam is normal. What is the appropriate therapy?

  17. 2) Another example of a scenario You have been invited to join a local implementation group to look at how to improve information services to those studying ethnomusicology at the University. The group agrees that they need to find out what ethnomusicologists need, before making any improvements.

  18. 2) Another example of a scenario

  19. 3) Find a relevant paper • Use key words from the scenario for database searching • Browse your favourite journals • Ask your librarian for help

  20. 4) Choose an appropriate checklist • Identify the study type of the paper • Google! www.google.co.uk • Adapt a checklist that is nearly appropriate • Remember: validity, reliability, applicability

  21. Finally.. • Write up a Critically Appraised Topic (CAT) for future reference www.ouls.ox.ac.uk/hcl • Evaluate: Did you find the process helpful? If not, why not? How could it be improved?

More Related