1 / 29

Enhancing Math Speech: Creating an Interactive Learning Environment

Explore a project aiming to enable computers to articulate math concepts using synthesized speech tailored to teachers’ preferred style. This aids visual impairment students in comprehending math better through interactive navigation. Discover research studies, development insights, and future directions.

wachter
Download Presentation

Enhancing Math Speech: Creating an Interactive Learning Environment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Making a Computer Speak Math Like a Teacher Would Beth Brownstein Educational Testing Service (ETS) Susan Osterhaus Texas School for the Blind and Visually Impaired. NCTM April 19, 2013

  2. Handouts are available at: www.atia.org/orlandohandouts Presentation Overview • Project Motivation, Goals, and Background • Development to date: discussion and demonstration • Research Studies • Next Steps

  3. Handouts are available at: www.atia.org/orlandohandouts Project Motivation • It is hard to get Math to speak right using a screen reader • ETS Experience

  4. Project Goals • High school algebra • Classroom-like synthesized speech “style”: ClearSpeak • Speech is flexible so computer will speak the way the teacher wants • Can be used in any math document – including both instruction and assessment • Interactive navigation • Author in Word with easy playback

  5. Handouts are available at: www.atia.org/orlandohandouts Not Part of Project • Braille • Support for other formats • Authoring by people with visual impairment • Solving math problems • Tutoring/Curriculum • Integration with standardized testing

  6. Handouts are available at: www.atia.org/orlandohandouts Behind the Scene: MathML (What is MathML?) <math><mroot><mi>x</mi><mn>3</mn></mroot></math>

  7. Project Software for Math • MathML Tools: • Authoring: MathType+Word • Audio rendering: MathPlayer • Screen reader • Window-Eyes (Word & IE)

  8. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  9. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  10. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  11. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  12. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  13. Handouts are available at: www.atia.org/orlandohandouts Many ways to Speak Math • How do you say…

  14. Handouts are available at: www.atia.org/orlandohandouts How Math Speech Works • Rules • Preferences • Exact Speech

  15. Handouts are available at: www.atia.org/orlandohandouts ClearSpeak • Many ways to speak math • ClearSpeak design philosophy • Other design philosophies • MathSpeak • SimpleSpeech

  16. Handouts are available at: www.atia.org/orlandohandouts Demonstration • Authoring • Using MathType in Word to enter math and use preferences • Entering exact speech in Word • Playback • Word with Window-Eyes

  17. Handouts are available at: www.atia.org/orlandohandouts Project Goals Recap • ClearSpeak • Author in Word • Allow setting preference and exact speech • Playback in Word and IE • Interactive navigation

  18. Creating Expressions and Questions for Studies • Level • Degree of complexity • Relevance of speech variations • Provide useful data • Test comprehension, not computation • Guide decisions about speech rules, preferences

  19. Handouts are available at: www.atia.org/orlandohandouts Feedback Study #1 • Compared ClearSpeak, MathSpeak, SimpleSpeech • Fractions, exponents, parentheses • Focus: was expression understood? • Research/Statistical consultation • 16 HS students: blind or low vision

  20. Handouts are available at: www.atia.org/orlandohandouts Results Summary • ClearSpeak more understandable than Simple Speech or MathSpeak • Students overall preferred ClearSpeak • Students got more answers correct with ClearSpeak than with Simple Speech or MathSpeak

  21. Handouts are available at: www.atia.org/orlandohandouts One Expression’s Results

  22. Familiarity and Understanding

  23. Handouts are available at: www.atia.org/orlandohandouts Feedback Study #2 • Can Prosody help understanding? • Pauses • Pitch • Rate Changes • Volume Changes • Rejected pitch and volume changes • non-speech sounds not an option • Focus on pauses, rate-change vs. start/end

  24. Handouts are available at: www.atia.org/orlandohandouts Feedback #2 Example vs. • With Pauses / rate change • Expression 1 • Expression 2 • With “end root” • Expression 1 • Expression 2

  25. Handouts are available at: www.atia.org/orlandohandouts Feedback #2 Another Example Nested Parentheses: • Uniform Pauses • Non-uniform pauses • Non-uniform pauses and “First Paren”

  26. Handouts are available at: www.atia.org/orlandohandouts Navigation • Simple char by char mode for beginners • Powerful navigation features for expert

  27. Handouts are available at: www.atia.org/orlandohandouts Participation Opportunities • Blind or Visually Impaired Students • Teachers

  28. Handouts are available at: www.atia.org/orlandohandouts Contact Information • Lois Frankel: lfrankel@ets.org • Neil Soiffer: neils@dessci.com • Beth Brownstein: bbrownstein@ets.org • Susan Osterhaus: susanosterhaus@tsbvi.edu • MathPlayer: http://www.dessci.com/en/products/mathplayer/ The research reported here was supported by the Institute of Education Sciences, U.S. Department of Education, through Grant R324A110355 to the Educational Testing Service. The opinions expressed are those of the authors and do not represent views of the Institute or the U.S. Department of Education.

  29. Handouts are available at: www.atia.org/orlandohandouts Thank you for attending this session

More Related