1 / 10

Motion Capture and Analysis of Tongue During Speech

Motion Capture and Analysis of Tongue During Speech . by Jared Kiraly. Purpose. Collect articulatory movement of tongue, lips, jaw, soft palate. Use this information to develop a realistic display of movement data, for biofeedback purposes. AG500.

leanna
Download Presentation

Motion Capture and Analysis of Tongue During Speech

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Motion Capture and Analysis of Tongue During Speech by Jared Kiraly

  2. Purpose • Collect articulatory movement of tongue, lips, jaw, soft palate. • Use this information to develop a realistic display of movement data, for biofeedback purposes.

  3. AG500 • The machine used to collect the data is the AG500 • Signal from 6 transmitter coils is recorded by the 12 sensors • After collection, data is translated into X, Y, Z position data, as well as tilt and yaw angles • Data is stored in binary double format

  4. Model Deformation • Vertices on a model are hand registered to correspond to sensor positions on tongue • These vertices are used as control points for radial basis function deformation • Radial basis function deformation moves points on a model towards a control vertex • Points farther from control vertex are affected less

  5. General Features Smoke trails for control points Ability to rotate/translate model while animating Option of viewing teeth/palate Coordinates displayed with animation Can rotate and translate model to view from all angles Use with “Reference Tongue” Side by side Overlapping Overlapping with one model transparent Ideas tried but not used Cross section Not deemed useful Boolean operations Too slow Visualizations of Moving Tongue

  6. Graphing Data • In addition to the visualization of the tongue, a program has been created to graph the captured data • Noise, bad data can be found more easily this way

  7. Issues/Future Work • Points on model have to be hand picked, and are hard-coded • Other data readings cannot be read in dynamically • Animation sometimes too slow • Motion appears jerky due to noise in data, even after the data has been filtered • Improved transmitter coils are being installed • Data collected from subjects does not yield good results • If sensors are placed too close together, they can interfere with one another

More Related