1 / 43

Understanding speech in the background of other sounds

Understanding speech in noisy environments is crucial for communication. This complex process impacts various age groups and can be especially challenging for those with hearing impairments or developmental disorders like autism spectrum disorders. Different types of noise interference, such as Energetic and Modulation Masking, affect how we perceive speech. Informational Masking, involving attention and auditory analysis, further complicates this task. The Signal-to-Noise Ratio (SNR) plays a key role in speech reception, as seen in studies like the Children’s Coordinate Response Measure (CCRM). Specific Language Impairment (SLI) and Autism Spectrum Disorders (ASD) present unique challenges in speech comprehension. This topic is essential for improving communication and aiding individuals facing difficulties in noisy settings.

felder
Download Presentation

Understanding speech in the background of other sounds

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Understanding speech in the background of other sounds It's complicated!

  2. Why is this interesting? • Speech is the major form of communication between people and most is not heard in quiet … • Even in a classroom • People of every age vary a lot in how well they can understand speech in the presence of ‘noise’ • Even when they have normal hearing … • And impaired hearing makes everything worse! • Lots of developmental disorders seem to have an impact on this ability • Language impairment • Autism spectrum disorders • Auditory processing disorder (APD)?

  3. Essential terminology • signalor target • what you are trying to listen to • typically speech or music or … • ‘noise’or masker • what you are trying to ignore • can be noise like from a hoover, but also other speech

  4. There are lots of different kinds of ‘noises’ ‘noise’ alone speech + ‘noise’

  5. Another kind of ‘noise’ ‘noise’ alone speech + ‘noise’ ‘show’ starts at t≈0.65 ms

  6. One major way that noises interfere • By the energy in the masker interacting directly with the speech in the inner ear… • making it inaudible, or • disrupting the information in the speech • Energetic (EM) and Modulation Masking (MM) • like the noise of a hoover • MM is the disruptive effect that modulations in the masker have on the modulations in the target • So it’s not the energy in the masker that is so important • Similar to EM, in happening at the periphery (needing to be in the same time/frequency region)

  7. Another way to interfere:Informational Masking • Everything else! • signal and masker ‘are both audible but the listener is unable to disentangle the elements of the target speech from a similar-sounding distracter’

  8. Two aspects of Informational Masking • Difficulties in auditory scene analysis • forming disparate acoustic elements into distinct and coherent sources of sound • Difficulties in attention • Example: your own name • Both abilities are more in the brain than in the ear • although they depend upon the quality of the signal coming from the ear Shinn-Cunningham, B. G. (2008). Object-based auditory and visual attention. Trends In Cognitive Sciences, 12, 182-186.

  9. More essential terminology Signal-to-Noise Ratio (SNR)

  10. Signal-to-Noise Ratio (SNR) The amount of energy in the signal divided by the amount of energy in the noise

  11. modulations dual tasking cognitive load concurrent task informational masking pupillometry cocktail party non-native listening vocal folds McGurk effect

  12. I’m a decibel.Kids love me. SNRs are usually expressed in decibels (dB)

  13. Getting to grips with SNRs SNR = +20 dB SNR = +10 dB SNR = 0 dB SNR = -10 dB SNR = -20 dB

  14. The Children’s Coordinate Response Measure (CCRM) aka ‘Doggy’ • Bouncy • in quiet in steady noise against another talker

  15. Performance measured adaptively Vary the: Signal-to-Noise Ratio (SNR) to find the: Speech Reception Threshold (SRT) [the SNR which leads to a fixed % correct, typically 50% or 79%] So the lower the better!

  16. Children can’t ignore another talker  better performance -1.7 -0.7 slopes

  17. Specific Language Impairment (SLI) • A specific deficit • occurs in the context of other cognitive abilities that are more or less normal. • SLI — Late-developing and severely impaired language abilities alongside more-or-less normal cognitive abilities.

  18. Email message from AZ when 15-years old Subject: RE: A New Warriors Date: Fri, 8 Aug 1997 11:07:40 -0400 Can you make a new warriors? (e.g I have planed a new space marine for the Blood Angels and I have called him The Blood Hurter. He got a jump pack on him and a rip arm from the tyranids and a orks head on his belt.)

  19. AZ: a child with SLI • Late to develop language, using 3 words at age 5: Mummy, Daddy, Gangan • Errors in plural forms: Two mens. Two foots. • Errors in verb tense: My dad go to work. This is what they ated. My mum make the breakfast. • Errors in the use of embedded phrases: Which cat Mrs White stroked? What did Mrs Brown dropped. • Nonverbal IQ  120-130

  20. Abook for parents http://www.ican.org.uk/

  21. Children with SLI find it hard ignore another talker  better performance – SRT (dB) 14 SLI & 17 TD children aged 6-11 years CCRM sentences PhD work of CsabaRedey-Nagy

  22. Autism Spectrum Disorders (ASD) • Primary problems in aspects of social interactions • Often accompanied by ‘sensory’ symptoms, e.g. hyperacusis

  23. A personal report from someone with ASD Being with a group of friends, and sitting in the middle, one conversation going on to my left and one to my right, no excessive background noise … when two are going at once, I can't follow either, so I usually just sit in silence.

  24. Some people with autism find it hard ignore another talker  better performance CCRM sentences PhD work of Katharine Mair

  25. Increased IM in older listeners • speech-shaped noise  better performance • 8-talker babble • 20s 30s 40s 50s 60s • age cohort • Rajan & Cainer (2008)

  26. So, what about hearing impairment?!

  27. Back to basics:A steady-state noise

  28. Much is understood about what makes a steady noise a good or bad masker • spectral shape • SNR

  29. Energetic & Modulation Masking • Noises interfere with speech to the extent that have energy in the same frequency regions • Can be quantified in the AI (articulation index) • or SII (speech intelligibility index) • Reflects direct interaction of masker and speech in the cochlea, which acts as a frequency analyser • Hearing impaired listeners are more affected by steady noises … • because they typically have impaired frequency selectivity (wider auditory filters).

  30. Better frequency selectivity keeps noise in its place

  31. But noises are typically not steady …

  32. Fluctuating maskers afford ‘glimpses’ of the target signal target glimpses masker a.k.a. ‘dip listening’ masker

  33. Hearing impaired listeners ‘glimpse’ less better performance → Performance in the SPIN task as a function of SNR for modulated and unmodulated noises (not an effect of ageing) Takahashi & Bacon (1992)

  34. Results from a special kind of auditory prosthesis:A cochlear implant

  35. The electrode array

  36. CI simulations

  37. CI users are greatly affected by noise SRT (dB)  better performance Bimodallistener } CI NH male target sentences Cullington & Zeng (2008)

  38. Final remarks Different kinds of background sounds affect speech intelligibility in different ways …

  39. Final remarks Even people with normal hearing can have an unusual degree of difficulty hearing speech in noisy backgrounds • young children • older people with normal hearing • children with language impairment • about half the people with High Functioning Autism

  40. Final remarks And the situation is worse with impaired hearing because of … • increased energetic and modulation masking • which also interferes with auditory scene analysis

  41. Thanks!

More Related