Usability Evaluation of an Online Resource for Teachers on Concussions

1. Usability Evaluation of an Online Resource Designed to Help Teachers to Recognize and Respond Appropriately to a Concussion Darryl Funai University of Hawaii at Manoa 4/22/14

2. Poll Question Have you or someone you know ever been concussed?

3. Background • 1.7 million people sustain a concussion every year (CDC, 2006)

4. Background • 1.7 million people sustain a concussion every year (CDC, 2006) • 60% of all teenage athletes will sustain a concussion before they graduate from high school. (Collins & Hawn, 2002)

5. What is a concussion? • A traumatic brain injury that can significantly influence the brain's ability to function at its normal capacity.

6. Rationale for study? • It is especially important for educators to know how to recognize a concussion

7. Rationale for study? • It is especially important for educators to know how to recognize a concussion • What to do if their student sustains a concussion

8. Rationale for study? • It is especially important for educators to know how to recognize a concussion • What to do if their student sustains a concussion • The importance of physical and mental rest, followed by a gradual progression back to activity

9. Rationale for study? • Information for specifically for educators is limited.

10. Rationale for study? • Information for specifically for educators is limited. • It is time consuming and ineffective for educators to curate information themselves.

11. Purpose • To evaluate the content and organization of a website designed to provide instruction and resources for educators to help them recognize and respond appropriately to a concussion.

12. Why a Usability Study? • Direct feedback from the target audience • Improve the users' experience • Quality content is only as good as the navigation of the website

13. Methods • Based on Krug's, Rocket Surgery Made Easy (2009)

14. Methods Timeline

15. Methods • Participant pool • 15 educators were contacted via email • 6 participants selected • Based on level of technical expertise and prior use of site • 2 iterations of 3 participants each

16. Methods • General comments • 4 tasks • Given in random order • 40 minutes to complete

17. Tasks • Please explain to me the schools Return to Play Protocol for Concussions.

18. Tasks • Please explain to me the schools Return to Play Protocol for Concussions. • Please explain to me the signs and symptoms of a concussion an educator might observe in their student.

19. Tasks • Please explain to me the schools Return to Play Protocol for Concussions. • Please explain to me the signs and symptoms of a concussion an educator might observe in their student. • Please open up the resource: "Heads up: Concussion in Youth Sports".

20. Tasks • Please explain to me the schools Return to Play Protocol for Concussions. • Please explain to me the signs and symptoms of a concussion an educator might observe in their student. • Please open up the resource: "Heads up: Concussion in Youth Sports". • Please explain to me how you may accommodate a student who has the following symptoms in your class: • Difficulty learning new concepts • Difficulty concentrating • Feeling slowed down

21. Results • Demographic Survey • 4 males and 2 females • Average 13 years of teaching experience • All participants have had a concussed student in their class • 17% reported having visited the site prior to test • 67% self rated at least a 4 on 5 pt. scale on comfort level navigating websites.

22. Results • Eight issues • Focused on top three • "Had to scroll down to bottom of page to find important information" • "Drop down boxes are confusing" • "Resources section doesn't make sense"

23. Discussion • Bagley, A. F., Daneshvar, D. H., Schanker, B. D., Zurakowski, D., dʼHemecourt, C. a, Nowinski, C. J., Goulet, K. (2012). Effectiveness of the SLICE program for youth concussion education. Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine, 22(5), 385–9. doi:10.1097/JSM.0b013e3182639bb4 • Glang, A., Koester, M., & Beaver, S. (2010) Online training in sports concussion for youth sports coaches. International Journal of Sports Science Coach, 5(1), 1–12. doi:10.1260/1747-9541.5.1.1. • Covassin, T., Elbin, R. J., & Sarmiento, K. (2012). Educating Coaches About Concussion in Sports: Evaluation of the CDC’s “Heads Up: Concussion in Youth Sports” Initiative. Journal of School Health, 82(5), 233–238. Retrieved from 10.1111/j.1746-1561.2012.00692.x • David, A., & Glore, P. (2010). The Impact of Design and Aesthetics on Usability, Credibility, and Learning in an Online Environment. Online Journal Of Distance Learning Administration, 13(4).

24. Results Official school website General Comments "clean" and "professional" Too much Information Liked video's

25. Discussion Too much information Can only see 1/3 of webpage when landing on webpage 2 Video's Before

26. Discussion Too much information Deleted Video Before After

27. Discussion Drop Down Boxes Confusing Easy to miss Before

28. Discussion Drop Down Boxes Before After Changed to make it consistent

29. Discussion Resources Confusing Before

30. Discussion Resources Videos PDF's After Before

31. Conclusion • Content and navigation well received • Informational and professional looking • Benefit from layout modification and additional usability testing

32. Questions? • dtfunai@hawaii.edu

33. References • Centers for Disease Control and Prevention (CDC). (2006) Traumatic Brain Injury in the United States: Emergency Department Visits, Hospitalizations and Deaths 2002 – 2006. • Collins, M.W., & Hawn, K.L. (2002, February). The clinical management of sports concussion. Current Sports Medicine Reports 1(1), 12-22. • David, A., & Glore, P. (2010). The Impact of Design and Aesthetics on Usability, Credibility, and Learning in an Online Environment. Online Journal Of Distance Learning Administration, 13(4). • Guskiewicz, K.M., Weaver, K.M., Padua, D.A., & Garrett, W.E. (2000). Epidimiology of concussion in collegiate and high school football players. American Journal of Sports Medicine, 28(5), 643-650. • Krug, S. (2009) Rocket surgery made easy: The do-it-yourself guide to finding and fixing usability problems. Berkeley, CA: New Riders Press. • McCrory, P., Meeuwisse, W. H., Aubry, M., Cantu, B., Dvorák, J., Echemendia, R. J., … Turner, M. (2013). Consensus statement on concussion in sport: the 4th International Conference on Concussion in Sport held in Zurich, November 2012. British journal of sports medicine, 47(5), 250–8. doi:10.1136/bjsports-2013-092313 • McCrea, M., Hammeke, T., Olsen, G., Leo, P., & Guskiewics, K. (2004). Unreported concussion in high school football players: Implications for prevention. Clinical Journal of Sports Medicine, 14(1), 13-17.