1 / 25

Prototype of Cyber Teaching Assistant

Prototype of Cyber Teaching Assistant. Prototype of. Cyber Teaching Assistant. Yoshiaki Shindo, Hiroshi Matsuda. Nippon Institute of Technology, Japan. Computer Room. Student’s Workstation. Teacher’s Cockpit. Nippon Institute of Technology.

brock
Download Presentation

Prototype of Cyber Teaching Assistant

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Prototype of Cyber Teaching Assistant Prototype of Cyber Teaching Assistant Yoshiaki Shindo, Hiroshi Matsuda • Nippon Institute of Technology, Japan

  2. Computer Room Student’s Workstation Teacher’s Cockpit Nippon Institute of Technology Constructed by Japan Information Processing Service Co. Ltd.

  3. System Outline of CTA Student's PC File Server Teacher'sPC Voice Speaking Scenario Database Remote Control CTA Local Area Network Start CTA in student's PC with specified scenario by remote control.

  4. Cyber Teaching Assistant (CTA) Voice speaking by Voice Synthesizer Subtitles are displayed. Installed in each Student’s PC

  5. Voice Speaking <SPEECH> Speech Text </SPEECH> Format Function Cyber Person reads aloud the Speech Text by Voice. Examples and Tag Option Switches <SPEECH>Hello Everyone.</SPEECH> <SPEECH Person=“Nana” Script=“ON”>Hello Everyone.</SPEECH> <SCRIPT Time=“50”>This is only a Caption Text.</SCRIPT>

  6. Facial Expression <FACE> Lyric Word </FACE> Format Function Cyber Person changes the Facial Expression. Examples and Tag Option Switches <FACE>Happy</FACE> <FACE TTC=“0,10,100,5,100,0”>Angry</FACE> <FACE Notify=“SYNC” Timing=“eStable”>Angry</FACE> <FACE Gain=“80,30”>Surprise</FACE>

  7. Data Flow of Facial Expression CPSL Engine AU/TTC Facial Expression Database FEN Lyric Word Database I am Happy Lyric Word CPSL Browser <FACE> <TALK> AU :Action Unit TTC:Time Transition Code AU: 60,120,260 Facial Expression Name FEN: Smile Lyric Word: Happy

  8. FACS-Action Unit and TTC Gain (%) EG RG Time GT ST RT TT Examples of FACS-AU TTC ( Time Transition Code ) 59 codes of AU are defined now. Examples of Facial Expression Unit of Time is 100mS GT : Gate Time TT : Transition Time ST : Stable Time RT : Release Time EG : Expression Gain(%) RG : Remain Gain(%) Smile Angry Sad FACS-AU is based on the FACS by P.K.Ekman’s research.

  9. Voice Speaking with Facial Expression <TALK> Speech Text </TALK> Format Function Cyber Person reads aloud the Speech Text by Voice and changes the facial expressionautomatically by detecting the lyric words. Examples and Tag Option Switches Those are the same. <TALK>I am very happy today.</TALK> <SPEECH> I am very happy<FACE>Smile</FACE> today. </SPEECH> Option Switches of <TALK> are the same as one of <SPEECH>

  10. Body Action by BACS-AU <ACTION> Action Word </ACTION> Format Function Cyber Person plays specified Body Action. Examples and Tag Option Switches <ACTION Gain=“80,30”>Lift up R.arm in Front</ACTION> <ACTION TTC=“0,10,100,5,100,0”>Bend R.knee </ACTION> <ACTION Notify=“SYNC” Timing=“eTransit”> Bend Ankles Outward </ACTION>

  11. Data Flow of Body Action CPSL Engine Motion Capture Matrix AU/TTC (BACS) Body Motion Database BPN Action Word Database Action Word CPSL Browser <TALK> <ACTION> BACS-AU :Action Unit TTC:Time Transition Code AU: 1470 Body Performance Name (BPN) Action Word: Bend Ankles Outward

  12. Body Action Coding System ( BACS ) Examples of BACS-AU 91 codes of BACS-AU are defined now. <ACTION Gain="50,50">Rotate Body to the Left</ACTION> <ACTION Gain="85,85">Raise Left Arm to the Front</ACTION> <ACTION>Rotate Rotate Face to the Right</ACTION> <ACTION Gain="35,35>Raise Left Forearm to the Front</ACTION>

  13. Body Action by Motion Capture <MOTION> Action Word </MOTION> Format Function Cyber Person plays specified Motion Capture data. Examples and Tag Option Switches <MOTION>BOWING </MOTION> <MOTION Person=“Emi” Repeat=“10”>WALKING </MOTION> <MOTION Notify=“SYNC” Rate=“4”>BOWING </MOTION> <MOTION Notify=“ASYNC” Rate=“6”>BOWING </MOTION> <MOTION Notify=“ABORT” Rate=“8”>BOWING </MOTION>

  14. Data Flow of Motion Capture CPSL Engine Motion Capture Matrix AU/TTC (BACS) Body Motion Database BPN Action Word Database Action Word CPSL Browser <TALK> <MOTION> Motion Capture Filename Filename: Walking.csv Body Performance Name BPN: Walking Action Word: WALKING

  15. BPN Encoder Motion Capture Data is made and edited by BPN Encoder and data is saved in Network File Server as a CSV format file. Motion Capture Data CSV format File Action Word Database BPN Encoder It captures the body action of human being and edits the captured data by mouse operation. Sophisticated body action can be played.

  16. Block Notification Unit of value is 100mS Block Notification defines the system behavior when CPSL browser encounters the </TAG> .

  17. Option Switches and State Variables State Variables are set by Tag-Option Switches. Scope of Variables Value of State Variables are kept in the Block defined by <TAG> and </TAG>.

  18. Creating Stage <STAGE> Format Function <Stage> creates the background stage. <STAGE TDM_FILE="CompEr1.tdm“ POSITION="600.0, -1300.0, -2200.0“ ROTATION="0.0, 0.0, 0.0“ SCALE="5.5, 5.5, 1.0“ > Stage is 3D-CG model made by Modeling Tool. 3D-CG Modeling Tool

  19. Texture Mapped Billboard Rectangleof Billboard Rotate to Face the Camera Automatically. Axis of rotation Mapping Photograph, Picture or Image data of Screen Capture. Background Color is converted to Transparent Pixel. Eye(Camera) Position Sideline of Rectangle and Axis of Rotation are Invisible. Easy way to create the stage .

  20. Creating Cyber Person <PERSON Option Switches > 3D-CG Modeling Tool <PERSON> creates the Cyber Person. More than one person can be defined. Required parameters must be specified by Option Switches.

  21. The other TAG commands

  22. Scenario Database for CTA For computer literacy course (1)  How to use the keyboard and Mouse. (2)  How to operate the tool bar of Word Processor. (3) How to edit the Document (4) How to print the document For computer programming course • How to use the Text Editor. • How to edit the compile errors. • How to edit the link errors. • How to set the break point.

  23. Conclusions • Cyber Teaching Assistant is a self-standing 3D-CG Real-Time Animation Software installed in each student’s PC. • Cyber Teaching Assistant is a Cyber Person who plays specified Scenario saved in the Network File Server. • Scenarios are written in CPSL ( Cyber Person Scenario Language), which is a TAG based Script Language. • Teacher can start any CTA from Teacher’s Cockpit by Remote CTA Starter.

  24. Demonstration of Cyber Teaching Assistant Scene 1. Explains the Error Message. Scene 2. Shows the Cause of Error. Scene 3. Show the solution to the problem.

  25. CTA Remote Starter CTA Starter Start Command with Scenario File Name Cyber Teaching Assistant Teacher’s Cockpit Scenario File Student’s PC Network File Server

More Related