1 / 13

Immersive Virtual Characters for Educating Medical Communication Skills

Immersive Virtual Characters for Educating Medical Communication Skills. J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine) M. Duerson Department of Community Health and Family Medicine (College of Medicine) K. Johnsen, R. Dickerson, A. Raij, B. Lok

vaughan
Download Presentation

Immersive Virtual Characters for Educating Medical Communication Skills

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Immersive Virtual Characters for Educating Medical Communication Skills J. Hernendez, A. Stevens, D. S. Lind Department of Surgery (College of Medicine) M. Duerson Department of Community Health and Family Medicine (College of Medicine) K. Johnsen, R. Dickerson, A. Raij, B. Lok Department of Computer and Information Science and Engineering (College of Engineering) The University of Florida, Gainesville, FL J. Jackson, M. ShinDepartment of Computer Science The University of North Carolina at Charlotte, Charlotte, NC

  2. What is a Virtual Character? • Virtual character - a character who represents the state of a system • In TRON (1982), humans and humans that represents software interacted within a world that represented the hardware.

  3. What is a Virtual Character • We aim to to have humans and human the represent software interact in the real world. r

  4. Virtual Character Research • Mostly • Rendering • Animation • Artificial Intelligence • Newer approaches • Affective power • Human response to VCs • Clinical Psychology • Fear of public speaking

  5. Motivation • “Doctor, I have a pain in my side!” • What you do next depends on: • Age • Gender • Ethnicity • Visual Cues • Audio Cues

  6. Motivation • Current methodologies • Books • Standardized Patients (actors) • Restricted in: • Training frequency • Scenario variety • Immediate feedback • Affects medical student preparedness • Provide additional training opportunities

  7. Solution • Interactive Virtual Characters • Life-Sized • Computer Generated • Natural Interaction • Responds to User • Responses based on accepted medical procedure • COTS Equipment: • Projectors • Laptops • Web cameras • Tablet PC

  8. Why Do We Want Virtual Characters? • Propose: Digital Characters as a new (meta-) medium to interact with information • Effective Interaction • Better than keyboard and mouse for certain tasks • Dynamic • 3D • Natural interaction • Low Bandwidth • Effective Collaboration • Controlled conveyed visual information • Non-verbal communication (60%)

  9. Thinking Digital Character Responding Perceiving Let’s look at interaction • Each participant in a communication has three stages: perception, cognition, and response • Define interaction as both the input and output Digital Character Thinking Responding Perceiving Interaction Perceiving Responding Thinking Participant

  10. Combines • Speech • Computer Vision • Eye Gaze • Gesture Recognition • Repeat your gestures • High Quality 3D models • Animation • Rendering • Visualization

  11. Integrates • Computer Science • Computer Graphics • Image Processing • Natural Language Processing • Medicine • Training • Education • Standardization • Education • Multimedia Learning • Technology based Learning • Training • What other areas could this be used for? • Psychology • Social Science • Education

  12. Current and Future Work • Current Status: • Initial scenario created with gesture, speech, and visualization components integrated • Evaluating with a group of Medical Students Year 2 • Future Work: • Formal evaluation studies • Increase and improve scenarios • Enhance interactivity • Show video

  13. Play Video

More Related