170 likes | 294 Views
Crisis in ANZCA survey research. Dave Story Head of Research, Department of Anaesthesia, Austin Health; A/Prof, Department of Surgery, The University of Melbourne Chair, ANZCA Trials Group. ANZCA Fellows are failing to respond to research surveys. Survey Research. Important research tool
E N D
Crisis in ANZCA survey research Dave Story Head of Research, Department of Anaesthesia, Austin Health; A/Prof, Department of Surgery, The University of Melbourne Chair, ANZCA Trials Group
Survey Research • Important research tool • Systematic collecting information on: • knowledge, • opinions, • practices • Sample from target population • Advantages • Quick • Cover wide geography • Cheap • Survey monkey
ANZCA Trials Group • TG asked by ANZCA to improve surveys • Facilitate survey research for Fellows and Trainees • -publishable standard • -review and advise • -avoid survey fatigue • -random sample of 500 • -protect privacy • -avoid direct mail • -anonymous http://www.anzca.edu.au/resources/trials-group
Trials Group and Surveys • Online form • HREC • Feedback • Need to know • Won’t send all
Value of survey data • Help policy • Government, College, Hospital, Departments • Pilot data for future studies • Knowledge of peers for individual anaesthetist
Problems with Response Rate 1. Reliability of result: Survey of 500 Fellows “I hate neurosurgeons” 40% agree 100% response (500) 95% CI = 36 to 44% 20% response (100) 95% CI = 31 to 50% 2. Non-responder bias: Are they different to responders? Eg Anaesthetists sleeping with neurosurgeons 3. Journals: Often reluctant under 60% response
Increase Response Rate? ANZCA TG: do better? • Scientific quality • Anonymous • Reminder (X 1) • Relevant topic: All vs SIG • Appropriate Sample size: not too many • Good cover letter – espec Formal project New? • Incentives: ?CPD points • Survey specific email address eg surveyresearch@anzca.edu.au
Increase Response Rate? Just answer the survey…
International Literature Systematic review 240 surveys (2000 to 2009) • Anaesthesia, • Anaesthesia and Intensive Care, • Anesthesia and Analgesia , • Anesthesiology, • British Journal of Anaesthesia, • Canadian Journal of Anaesthesia Median response rate 71% (IQR: 57 to 85%, range 11 to 100%). 74 (31%) a response rate less than 60% Story et al, Anesth Analg, ????
ANZCA Surveys 10 ANZCA surveys • 5 published • 5 presented Median response: 35% Range: 25 to 57%
We are not alone… Medical Journal of Australia, 2010
Survey research reporting (conduct) Trials Group: Jones D et al. An introductory guide to survey research in anaesthesia. Anaesth Intensive Care, 2006 Story et al, Anesth Analg, IN PRESS
The Future Options for guidelines for reporting surveys (conduct) 1. Do nothing 2. Editors select guidelines already published 3. International consensus (CONSORT) ANZCA: Fellows + Trainees Why are they not responding: time, interest? Try new strategies to get Fellows and Trainees to…
The Editor says... Only a 50% response rate! Thanks