1 / 43

Speech Perception:

Speech Perception:. Theoretical approaches. Scope of the problem. Speech perception involves the mapping of speech acoustic signals onto linguistic messages (e.g., phonemes, distinctive features, syllables, words, phrases…). Why is the problem theoretically hard to solve?.

MikeCarlo
Download Presentation

Speech Perception:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Speech Perception: Theoretical approaches

  2. Scope of the problem • Speech perception involves the mapping of speech acoustic signals onto linguistic messages (e.g., phonemes, distinctive features, syllables, words, phrases…)

  3. Why is the problem theoretically hard to solve? • Acoustic variability due to context, talker, dialect, rate, prosodic, and other differences. • Segmentation problems

  4. Three theoretical approaches: • Motor theory • Direct realism • General approach

  5. Motor theory of speech perception(Liberman & Mattingly, 1985) • Listeners perceive gestures (more specifically, intended gestures, or neuromotor commands). • Speech is perceived in humans by means of a specialized speech module.

  6. How the speech module works: …“the candidate signal descriptions are computed by an analogue of the production process—an internal, innately specified vocal-tract synthesizer…—that incorporates complete information about the anatomical and physiological characteristics of the vocal tract and also about the articulatory and acoustic consequences of linguistically significant gestures” (Liberman & Mattingly, 1985, p. 26).

  7. Spectrograms of /di/ and /du/

  8. Direct realist theory of speech perception (C. Fowler) • Derived from James J. Gibson’s perceptual theory. • Objects of speech perception are actual gestures. • No special mechanisms are required.

  9. How direct realism works: • “Perceptual systems have a universal function. They constitute the sole means by which animals can know their niches. Moreover, they appear to serve this function in one way: They use structure in the media that has been lawfully caused by events in the environment as information for the events. Even though it is the structure in media (light for vision, skin for touch, air for hearing) that sense organs transduce, it is not the structure in those media that animals perceive. Rather, essentially for their survival, they perceive the components of their niche that caused the structure.” (Fowler, 1996, p. 1732)

  10. General approach to speech perception (Diehl, Lotto, & Holt, 2004) • Objects of speech perception are (primarily) acoustic/auditory events. • Speech perception relies on general mechanisms of audition and perceptual learning.

  11. Variation in VOT

  12. Spectrograms of English /ba/ and /pa/

  13. VOT frequency histograms of voicing categories across six languages (Lisker & Abramson, 1964)

  14. English identification functions for VOT stimuli superimposed on VOT frequency histograms

  15. English discrimination functions for VOT stimuli

  16. Thai identification functions for VOT stimuli superimposed on Thai VOT frequency histograms

  17. Thai discrimination functions for VOT stimuli

  18. -50 TOT +50 TOT 0TOT Frequency (Hz) Time (ms) 50 ms 50 ms Tone onset time (TOT): a nonspeech analog of Voice onset time (VOT) (Pisoni, 1977; Holt, Lotto, & Diehl, 2004)

  19. Discrimination functions for TOT stimuli (Holt,Lotto,& Diehl, 2004)

  20. VOT “identification” by chinchillas(Kuhl & Miller, 1981)

  21. /ga/-/ka/ identification by typically developing children and dyslexic children (with and without ADHD)

  22. Back to the three approaches to speech perception • Motor theory • Direct realism • General approach

More Related