1 / 30

A Multisensory and Multimodal Game for Children with Cochlear Implants

A Multisensory and Multimodal Game for Children with Cochlear Implants. Maria Carmela Sogono Supervisor: Dr. Deborah Richards ITEC810 Information Technology Project Department of Computing, Macquarie University. Agenda. Problem Related work Methodology Outcomes Design principles

keran
Download Presentation

A Multisensory and Multimodal Game for Children with Cochlear Implants

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A MultisensoryandMultimodal GameforChildrenwithCochlear Implants Maria Carmela Sogono Supervisor: Dr. Deborah Richards ITEC810 Information Technology Project Department of Computing, Macquarie University

  2. Agenda • Problem • Related work • Methodology • Outcomes • Design principles • Instructional design • Game evaluation • Conclusion

  3. Problem Even with hearing aids, quality is still not the same as with normal hearing Problems in areas such as sound localisation Can affect brain development in children Can a multimodal, multisensorygame be used to test, train, and improve soundlocalisation acuity? Photo source: http://www.flickr.com/photos/adwriter/1305191984/

  4. Why focus on children? MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM MMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMMM • 35:10000 children • Normal hearing is important for brain development

  5. Why focus on SSD? There is less help available for children with SSD. Photo source: http://www.firefliesandjellybeans.com/2012/05/can-you-hear-me-now.html

  6. What is sound localisation? The ability to identify where sound has come from Photo source: http://www.flickr.com/photos/reverses/5098858054/

  7. Baha Processes sound from the impaired side and sends it to the hearing ear Bone anchored hearing aid Photo source: http://products.cochlearamericas.com/diagram/baha-system

  8. Would it be possible to improve sound localisation acuity forchildren with SSDandBahas?

  9. How? Multisensory Multimodal • Supported by perceptual motor training theory • Supported by technological advancements Games • To appeal to the target audience • To make it easier to track, collect, then analyse data

  10. Would it be possible to improve sound localisation acuity forchildren with SSDandBahas? Can we design games to improve sound localisation acuity forchildren with SSDandBahas?

  11. Relevant work • Research studies testing sound localisation acuity • Existing sound localisation games developed at Macquarie University • Other games developed for children with SSD Photo source: http://www.flickr.com/photos/driek/5412231453/

  12. Methodology 1. Review of relatedliterature

  13. Methodology 2. Analysis of existing work

  14. Methodology 3. Development of design principles

  15. Methodology 4. Development of instructional design template

  16. Methodology 5. Development of game evaluation guidelines

  17. Design principles • The learning environment shall be realistic. • The stimulus shall be meaningful. • The game shall start at an easy level. • When the game level of difficulty increases, the increase shall be incremental. • The game shall incorporate motivational elements. • The game shall provide feedback after each trial.

  18. Design principles • The game shall propose a challenge. • The game shall make use of fantasy. • The game shall incorporate sensory and cognitivecuriosity. • The game shall adapt to the user’s progress. • The game shall allow for the repetition of tasks. • The game shall track user data. • The game shall use bright colours.

  19. Design principles • The game shall be visually appealing to the target audience. • The game shall make use of high-quality audio. • The game shall allow for sound to originate from at least 2 distinct sources. • A non-accented, trained voice shall be used. • The game shall make use of multiple modalities.

  20. Interaction modalities

  21. Instructional design template

  22. Instructional design template

  23. Sample game modules Bug Killer Treasure Hunt Wild Animal Evasion Dance Beat Shooter, sound identification Adventure, sound tracking Maze, sound evasion Rhythm action, sound training

  24. Game evaluation “Does the game follow design principlesand best practices?” • Game design • Usability • Content “Is the game usable?” “Does the game teach what it’s supposed to?”

  25. Game design evaluation

  26. Game design evaluation

  27. Game modules evaluated Bug Killer Treasure Hunt Wild Animal Evasion Dance Beat 4 3.22 3.89 3.11

  28. Conclusion

  29. Recommendations • Augmented reality • Multiplayer games • Haptic, large scale mats • Games for adults

  30. Thank you! For questions, contact maria-carmela.sogono@students.mq.edu.au

More Related