Using SurveyMonkey: Advantages and Problems

1. Using SurveyMonkey:Advantages and Problems • Jill Rosenbaum B.A.

2. Our Research • Describe how competing commitments, adhering to protocol and providing good clinical care, are managed in clinical trials (CTs) • Describe how this competition arises in different methodological domains (e.g., recruitment, randomization), study designs and medical situations. • Ascertain the frequency of perceived conflicts. • Determine the correlates of violations of the rules of the CT.

3. First Steps • What questions should we ask? Interview Physicians and Nurses about competition between trial design and good care of subjects • Pilot interview questions with both nurses and physicians • Develop list of survey subjects from Centerwatch.com

4. The Dillman Method5 Necessary Elements For Achieving High Response Rate • A respondent-friendly survey 2)Inclusion of stamped return envelopes. 3)Five varied contacts with survey recipients 4) Personalized correspondence. 5) Include token financial incentive in the same mailing as the survey.

5. A Respondent-friendly Survey We achieved this through: • Trial and Error • Piloting survey on physicians and nurses • Rewording questions for coherence • Revamping survey • Eliminating complex questions

6. Inclusion of returned stamped envelopes • Because ours was an internet survey, we eliminated this step.

7. 5 Varied contacts with survey recipients • 1st contact - letter requesting participation in an online survey • 2nd contact - email with link to the survey • 3rd contact - thank you letter / reminder • 4th contact - resend email with link to the survey • 5th contact - telephone call • 6th contact - with link to the survey (not traceable)

8. Personalized Correspondence • Each letter was hand signed. • Each letter was personalized with recipient’s name and address. • Personal notes on some letters. • Personal phone calls were made to track down non-respondents. • Each envelope was stamped.

9. Token Financial Incentive • We included a $10 Starbucks gift card with the original mailing. • The gift card was offered as an incentive for completing the survey, not as a reward for completion of it.

10. What is SurveyMonkey? • An on-line survey system • Automates much of the process of designing and implementing surveys • Basic analysis • Reasonable price

11. Designing Surveys • Can be done on-line • Can adjust appearance • Examples:

15. Many different Question Types • There are 17 different question formats that you can use.

16. Single Answer Vertical

17. Multiple Answer

18. Matrices

19. Open-ended

20. Features of Questions • On-line refusal • Conditional Logic - Questions asked depending on other answers • Require answers to essential questions • Add your own logo to the Survey • Send respondents to specific follow-up page when complete

21. Data Collection • Automatic invitation to uploaded list of emails • Automated reminders • Automatic Data Collection - No data entry!

22. Analysis • Output to Excel format • Prepared output of frequencies • Specify simple bivariate analyses

23. Our Results Overall, we achieved a 75.4% response rate to our survey. Response rate for M.D.s - 57% Response rate for study coordinators, nurses, etc. 80.5%