1 / 28

Roy Patterson Centre for the Neural Basis of Hearing Department of Physiology, Development and Neuroscience Univer

Part II: Lent Term 2014: ( 1 of 4). Central Auditory Processing. Roy Patterson Centre for the Neural Basis of Hearing Department of Physiology, Development and Neuroscience University of Cambridge. email   rdp1@cam.ac.uk. Lecture slides on CamTools : .

dava
Download Presentation

Roy Patterson Centre for the Neural Basis of Hearing Department of Physiology, Development and Neuroscience Univer

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Part II: Lent Term 2014: ( 1of 4) Central Auditory Processing Roy Patterson Centre for the Neural Basis of Hearing Department of Physiology, Development and Neuroscience University of Cambridge email   rdp1@cam.ac.uk Lecture slides on CamTools: Lecture slides, sounds, videos and background papers on http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/

  2. axial axial The Overture Act I:the information in communication sounds (animal calls, speech, musical notes) Act II:the perception of communication sounds (the robustness of perception) Act III: the processing of communication sounds: How (auditory signal processing) [Tune7nCPHtone.mov] Act IV:the processing of communication sounds: Where (auditory anatomy, physiology, brain imaging)

  3. Act I The form of communication sounds including speech and musical notes http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

  4. Pulse Resonance to declare territories and attract mates, are typically Sounds used to communicate at a distance, Pulse-Resonance Sounds The pulse marks the start of the communication. Amplitude • The resonance provides distinctive information about the shape and size of resonators in the sender’s body. Time

  5. The pulses are produced in streams, each with a resonance source-filter systems : pulse-resonance sounds source filter The streams have distinctive onsets and offsets, and a stream with its onset and offset is referred to as a syllable. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf

  6. Communication ‘syllables’ of four different animals Fish Frog 400 ms Patterson, Smith, van Dinther and Walters (2008). Macaque Human

  7. VT shape determines resonance shape (vowel type) The information in speech sounds: VT length determines resonance rate /a/m VC mass determines GPR (voice pitch) Long vocal tract ~ Man

  8. The information in speech sounds: VT length determines resonance rate /a/m /a/w 2/3 Long vocal tract ~ Man Shorter vocal tract ~ Woman

  9. Patterson, Smith, van Dinther and Walters (2008). Low Long Pitch VTL High Short Time Time

  10. In natural communication sounds, at the syllable level, there are three important kinds of information: • resonance shape  the message • glottal pulse rate  pitch • resonance scale  resonator size, or body size What happens as a child grows up into an adult? http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf

  11. pulse rate resonance shape envelope shape fine structure waveform and spectrum of a child’s /a/

  12. pulse rate resonance rate position of the envelope position of the fine-structure waveform and spectrum of a child’s /a/ Sf Ss Frequency on a logarithmic axis (octaves)

  13. Decreasing VTL Increasing GPR The role of Ssand Sfin speaker perception (1/Sf ) (Ss ) Kawahara and Irino (2004). Principles of speech manipulation system STRAIGHT. In Speech separation by humans and machines, P. Divenyi (Ed.), Kluwer Academic, 167-179.

  14. Instrument Family Instrument Register SsandSf The role of Ssand Sfin instrument perception Envelope Shape http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

  15. Acoustic scale in instrument perception violin Instruments with same shape and construction, sound similar. viola cello Envelope Shape SsandSf Register

  16. Instrument Family Instrument Register The perception of musical notes and instruments SsandSf Envelope Shape

  17. resonance Waveforms for trumpet and trombone van Dinther and Patterson (2004) pulses Time

  18. French Horn (1/Sf) Decreasing Size (Ss) Pitch The effect of Ssand Sfon instrument perception

  19. Instrument Family Instrument Register The perception of musical notes and instruments SsandSf Envelope Shape

  20. The acoustic scale values in communication sounds tell us about the register of an individual or instrument within a population of people or a family or instruments The ratio of the acoustic scale values provides information about the quality of an instrument or the naturalness of an individual’s voice http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf

  21. Sf Ss pi pekokuuuni ne momuuu

  22. pi pe ko kuuu ni ne mo muuu pi pe ko kuuu ni ne mo muuu pi pe ko kuuu ni ne mo muuu

  23. 1/VTL (1/Sf ) Position of the envelope Position of the fine structure

  24. 1/VTL (1/Sf )

  25. General conclusions: Partitioning the information in the magnitude spectrum into (a) envelope shape, (b) position of the envelope, Sf,and (c)position of thefine structure, Ss, provides us with the basis for a structured description of the perception of communication sounds.

  26. I: The shape of the envelope largely determines vowel type. It determines the “What” aspect of the communication, in the sense of “What is being said”. II: The acoustic scale variables, SsandSf jointly determine the register of the voice, and whether the speaker sounds normal or unusual. They jointly determine much of the “Who” aspect of the communication in the sense of “Who is speaking”. What and Who in vocal sounds

  27. I: The shape of the envelope/resonance largely determines the sound of the instrument family, or the family aspect of instrument perception. III: The relationship between the acoustic scale variables, SsandSf determines whether an instrument sounds good. II: The acoustic scale variables, SsandSf, jointly determine the registeror size aspect of instrument perception. Family and Register in musical sounds

  28. End of Act I Thank you Patterson, R. D., Smith, D. R. R., van Dinther, R. and Walters, T. C. (2008). “Size Information in the Production and Perception of Communication Sounds,” In: Auditory Perception of Sound Sources.Yost, W. A., Popper, A. N., and Fay, R. R. (Eds). Springer, LLC, New York, 43-75. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PSDWshar08.pdf Patterson, R. D., Gaudrain, E. and Walters, T. C. (2010). “The perception of family and register in musical tones,” In: Music Perception. Jones, M.R., Fay, R.R. and Popper, A.N., (eds).  New York, Springer-Verlag. 13-50. http://www.pdn.cam.ac.uk/groups/cnbh/teaching/lectures/PGW_SHAR_2010.pdf Patterson, R. D., van Dinther, R. and Irino, T. (2007). “The robustness of bio-acoustic communication and the role of normalization,” Proc. 19th International Congress on Acoustics, Madrid, Sept, ppa-07-011.

More Related