1 / 21

asc-inclusion.eu

A project to develop software to assist people with autism to recognise , understand and express emotions through facial expressions , voice and body gestures. www.asc-inclusion.eu. Autism & Emotions.

daniel-mullen
Download Presentation

asc-inclusion.eu

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A project to develop software to assist people with autism to recognise, understand and express emotions through facial expressions, voice and body gestures www.asc-inclusion.eu

  2. Autism & Emotions • Difficulties recognizing and understanding mental states: • Their own • In other people • Aspects of difficulty include: • Facial expressions • Vocal intonation • Body gestures and body language • The integration of the above in context • Difficulties in expressingemotions non-verbally, in all the above aspects. • Emotion recognition and expression are not learned spontaneously >>> need to be taught explicitly. Risk of social exclusion for individuals with autism is significantly increased without these skills. www.ascinclusion.eu

  3. Project Introduction • A project to develop interactive games to assist people withautismto recognise, understand and express emotions through facial expressions, voice and body gestures • Primarily for childrenaged 5 to 10, high functioning • Can serve teenagers and youngadults (withproper accommodations) • Can serve more populations that are sociallychallenged, such as: ADHD, Hearingimpaired

  4. Project Partners Prof. Simon Baron-Cohen, head of the Autism Research Centre at Cambridge University, UK Prof. Sven Bölte, Karolinska Institutet, Sweden Dr. Ofer Golan, Bar-Ilan University, Israel Prof. Peter Robinson, head of Cambridge Computer Lab, UK Prof. Björn Schuller, Technische Universität München, Germany Prof. Antonio Camurri, University of Genova, Italy Autism-Europe (AE) Executive comitee www.ascinclusion.eu

  5. Project Method & Rationale The ASC-Inclusion software will: • Analysethe children’s facial expressions, vocal intonations and gestures (standard microphones and webcams); • Trainchildren to recognise and express emotions through Interactive lessons, fun games, animations, video clips; • Personalisesettings according to children’s individual needs; • Supporttherapists and parents with professional information, reports on children’s progress and forums to interact with other carers. www.ascinclusion.eu

  6. How the software will work Innovation meets intervention The program will consist of 3 state-of-the-art subsystems for: • Facial expressions • Vocal intonation • Body gestures The subsystems will be integrated together in an online virtual world platform to provide the user with a comprehensive and motivating learning experience. www.ascinclusion.eu

  7. How the software will work Facial expressions www.ascinclusion.eu

  8. How the software will work Vocal intonation www.ascinclusion.eu

  9. How the software will work Body gestures www.ascinclusion.eu

  10. Environment – Narrative Environment narrative: Complete fun learning tasks to earn more fun stuff! The players are researchers in an international research camp located in the jungle. They research human behaviour and emotional expression.

  11. Avatar: Create your character Click on different shapes of mouth, eyes, eyebrows etc. to express your mood

  12. Main area: The research CenterGet a task, see your research status, meet the mentor, use research tools

  13. Motivational Elements: HomeTake a canoe to your home or visit a friend’s home, design your home

  14. Motivational Elements: GoodiesUse the virtual coins you earned by completing “research missions” (=learning tasks) to purchase items for your home, avatar and collections

  15. Motivational Elements: GamesPlay cool games using your virtual money, meet friends

  16. Games: Facial expression Mahjong: Attention to details Initial level: Match happy faces. Advanced level: Match different people who feel the same.

  17. Games: Emotional tone of voice Recognise what the speakers feel according to their voice

  18. Games: Body language hints Edit your own movie using the hints you’ve learned

  19. Games: Cross-modal training Match picture to sound: Listen to Timmy. Click on the picture of the character who feels like Timmy.

  20. Interactive books: Social scenes Enjoy funny stories on everyday social situations Create your own ending, Invent more comics stories with the characters

  21. Testing Game A highly rewarding learning:Answer the questions and win a million coins!

More Related