1 / 13

Oh!

Oh!. Helping your child to learn Facial Expressions http://oh.cloudapp.net/oh. Our Team members. Justin > Kinect Development > main idea Zong > Kinect Development David > Audio input > Kinect Development Marion > Social Media Tebo > Reporting loop for Therapy and Parent Monitoring

tauret
Download Presentation

Oh!

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Oh! Helping your child to learn Facial Expressions http://oh.cloudapp.net/oh

  2. Our Team members • Justin > Kinect Development > main idea • Zong > Kinect Development • David > Audio input > Kinect Development • Marion > Social Media • Tebo > Reporting loop for Therapy and Parent Monitoring • Kelesy > Asset creation > UI Layout • Aimee Maree > Gamification > Team Strategy • Nick > Start-up strategy > Team Mentoring

  3. Our Mission • Help Teach Facial Expression

  4. Key Areas • Aimed at Children 3 > 5 • Early Intervention • Help them recognise facial expressions • Provide meta-data capture in order to create reports that can be shared between parents, therapists and teachers

  5. Adding interactivity to a proven method • In the past therapists, teachers and parents have used Flash Cards to teach Autistic Children facial expressions • There are now tablet applications that enable the Flash Card model to be used on a tablet to enable some touch interaction • We want to take that proven method and add some new features that suit todays modern immersive methods of education • Show that immersive technologies such as the Kinect can help foster new learning environments

  6. What are we doing that is different • Adding a new level of interaction with the Kinect motion detection • Adding in a new level of reward systems • Allowing for a digital report to be captured and shared between selected parties to monitor the child’s progress • Allowing for a level of customisation to allow Therapists, Parents and Teachers a way to make the application personalised • To enable to Child to have a one on one relationship with the subject matter by way of seeing their own face as well as having rewards that they are interested in (aka Cars Video, MineCraft videos etc)

  7. Why customisation is important? • At recent SXSW “Apps for Autism” presentation the main feedback from therapists and Parents was “We Want to Customise our applications” • At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of” • Customisation enables the application to grow with the child and for them to see their own facial expressions • Rewards are customised through the selection of “You Tube” videos that the child relates to > For example “Steve’s” Child likes the Cars movie he can select a “You Tube” video of Cars

  8. Meta-Data collection and Reporting • Reports are collected at points through-out the apps • The reports are sent to the “Cloud” • At the Bing Fund “Apps for Autism” presentations we heard “Customisation is the key to tools and one thing we don’t see enough of” • Customisation enables the application to grow with the child and for them to see their own facial expressions

  9. Cognitive Aspects • Enabling a child to see their own Face making a facial expression • Enabling a child to understand the shape that represents an expression • Fostering neural paths between shapes and expression • Allowing for the child to categorise expressions and related shapes • Allowing a child to not just see a picture of a Smile but to see themselves Smiling to enable further pathway building and strengthing

  10. Main Technologies • Kinect SDK > To provide an interactive interface for learning • HTML / CSS / JS > to provide animations and UI layout • Azure > to provide a centralised place for reporting and to enable Parent / Teacher / Therapist login • Windows Desktop Application > First prototype to run on a desktop, future builds can run in Metro 8 UI and Xbox Live

  11. High level view of WorkFlow Three levels Animation Reward Game progression through levels Capture meta-data for therapists and parents to enable monitoring of a child's progression

  12. Our Prototype

  13. Resources What makes a Good Autism App Autism Expert Bodies http://bridgingapps.org http://www.autismspeaks.org/ http://www.autismspectrum.org.au http://globalautismawareness.blogspot.com http://www.templegrandin.com/ • http://momswithapps.com/2010/08/04/characteristics-of-great-apps-for-kids-with-autism/ • http://bridgingapps.org/2013/03/apps-for-autism-presentation-at-sxsw-13/ • http://www.iidc.indiana.edu/?pageId=601

More Related