1 / 15

SimCoach – Authoring

SimCoach – Authoring. Eric Forbell , Nicolai Kalisch, Kelly Christoffersen , Glenn Storm, Kevin Feeley , Fabrizio Morbini. USC Institute for Creative Technologies. 2. SimCoach as a Platform.

chessa
Download Presentation

SimCoach – Authoring

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SimCoach– Authoring Eric Forbell, Nicolai Kalisch, Kelly Christoffersen, Glenn Storm, Kevin Feeley, Fabrizio Morbini USC Institute for Creative Technologies 2

  2. SimCoach as a Platform • SimCoach is a technology platform thatenables rapidly developed virtual humans hosted in a web environment • Enables more ubiquitous and scalable virtual humans and content • Builds upon maturing virtual human technologies • Built upon open web standards, promoting adoption • Supports true conversational agents that take initiative • Suitable for a variety of complex domains • Enables interactivity with a vast set of existing and future web resources • Direct embedding of YouTube, Web articles, Website links, other online media

  3. Building authorable virtual humans • Challenges • Virtual Humans have complex data-driven components • Tools are typically not unified and unwieldy for non-technical authors • Balance between simplicity and expressivity • Different applications impose different requirements • Training is more focused, but requires assessment • Support systems like SimCoach face more uncertainty with users Agent Natural Language Understanding Nonverbal Behavior Generation Natural Language Generation Multimodal Perception & Understanding Speech Recognition Animation Speech Generation Renderer Human User Framework

  4. SimCoach Authoring Approach • Preliminary Goals • Build a unified tool to create complete virtual characters • Author, test and iterate – all in the same environment • Minimize barriers for getting started • Tool is fully web-based, nothing to install or configure • Use available technologies, invent only when necessary • Empower the author, restrict only when necessary • Construct a solid architectural foundation to support domain-specific authoring applications

  5. SimCoach Architecture – What needs authoring? Dialogue policy Dialogue Management Information state Utterances Speech Audio Action Realization Resources Speech Analysis Non-verbal Behavior generation Classifier model Textual Language Understanding Multimedia Resources Animation Video Animation Fusion Speech Audio Animation Library 3D Character Web client Human User Behavior Rules Framework

  6. SimCoach Authoring Tools Early design iterations

  7. Authoring Process • Create project • Select 3D character model from library • Build interaction logic • Compose interaction through sub-dialogue scripts activated by state variables and user actions Question.what-is-PTSD question.confidentiality consentToPTSDQuestionnaire == true • Train language understanding • For all specified user dialogue actions, provide exemplar text and variants • Refine character actions • Edit character utterances • Import speech audio, render animations

  8. Automated Character Animation Workflow FaceFX Enabling technology for web-hosted characters NVBG Smartbody Maya encoder Can parallelize here! Maya Maya Maya Maya Maya

  9. TOOLS DEMO PRE-ALPHA TECH PREVIEW

  10. Future Work • Build tutorials and in-tool support for new authors • Improve overall usability • Some changes may be very invasive, but necessary • Simplify creation of common dialogue behaviors • Introduce behavior templates • Improve author control and preview of nonverbal behavior • In process on DCAPS • Enhance testing framework to help debug • Provide support for other simulation environments • Standalone, non-web simulations

  11. TOOLS DEMO PRE-ALPHA TECH PREVIEW

More Related