1 / 212

From Here to Utility Melding Phonetic Insight With Speech Technology Steven Greenberg

From Here to Utility Melding Phonetic Insight With Speech Technology Steven Greenberg International Computer Science Institute 1947 Center Street, Berkeley, CA 94704 http://www.icsi.berkeley.edu/~steveng steveng@icsi.berkeley.edu. Acknowledgements and Thanks.

tausiq
Download Presentation

From Here to Utility Melding Phonetic Insight With Speech Technology Steven Greenberg

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. From Here to Utility Melding Phonetic Insight With Speech Technology Steven Greenberg International Computer Science Institute 1947 Center Street, Berkeley, CA 94704 http://www.icsi.berkeley.edu/~steveng steveng@icsi.berkeley.edu

  2. Acknowledgements and Thanks Automatic Feature Classification and Analysis Joy Hollenback, Shawn Chang, Leah Hitchcock Research Funding U.S. National Science Foundation U.S. Department of Defense

  3. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language

  4. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language The Varieties of Scientific Experience • The Fundamental Duality • The Eternal Pentangle • The Inner Triangle

  5. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language The Varieties of Scientific Experience • The Fundamental Duality • The Eternal Pentangle • The Inner Triangle The Importance of Being Phonetically Annotated • A Corpus-Centric Perspective on Spoken Language • Phonetic Annotation of Spontaneous American English Discourse

  6. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language The Varieties of Scientific Experience • The Fundamental Duality • The Eternal Pentangle • The Inner Triangle The Importance of Being Phonetically Annotated • A Corpus-Centric Perspective on Spoken Language • Phonetic Annotation of Spontaneous American English Discourse Phonetic Dissection of Automatic Speech Recognition Systems • Stress Accent and Word Error Rate • Syllable Structure and Word Error Rate

  7. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language The Varieties of Scientific Experience • The Fundamental Duality • The Eternal Pentangle • The Inner Triangle The Importance of Being Phonetically Annotated • A Corpus-Centric Perspective on Spoken Language • Phonetic Annotation of Spontaneous American English Discourse Phonetic Dissection of Automatic Speech Recognition Systems • Stress Accent and Word Error Rate • Syllable Structure and Word Error Rate The Relation Between Stress Accent and Vocalic Identity • The Relation Between Segmental Duration and Vowel Height • Durational Differences Between Stressed and Unstressed Vowels • The Relation Between Vowel Height and Stress Accent

  8. Road Map of the Presentation What is Truth? • The story of Rashomon, a film by Akira Kurosawa • Its application to spoken language The Varieties of Scientific Experience • The Fundamental Duality • The Eternal Pentangle • The Inner Triangle The Importance of Being Phonetically Annotated • A Corpus-Centric Perspective on Spoken Language • Phonetic Annotation of Spontaneous American English Discourse Phonetic Dissection of Automatic Speech Recognition Systems • Stress Accent and Word Error Rate • Syllable Structure and Word Error Rate The Relation Between Stress Accent and Vocalic Identity • The Relation Between Segmental Duration and Vowel Height • Durational Differences Between Stressed and Unstressed Vowels • The Relation Between Vowel Height and Stress Accent Spoken Language – What is Truth? • Fundamental Questions Remain Unanswered

  9. Part One WHAT IS TRUTH? The Story of Rashomon Its Moral for the Study of Spoken Language

  10. Rashomon – What is Truth? It is twelfth-century Japan, and a nobleman has died ….

  11. Rashomon – What is Truth? This we learn from a conversation between a woodcutter, a priest and a peasant under a gate in the ancient city of Kyoto ….

  12. Rashomon – What is Truth? The woodcutter and the priest have just come from a judicial inquest into the death, and are telling the peasant what they have heard

  13. Rashomon – What is Truth? The woodcutter and the priest have just come from a judicial inquest into the death, and are telling the peasant what they have heard The woodcutter testified at the inquest, having witnessed the sequence of events resulting in the Nobleman’s death

  14. Rashomon – What is Truth? The story begins with the capture of the notorious bandit, Tajomaru, who is the accused in the nobleman’s death ….

  15. Rashomon – What is Truth? The nobleman and his wife had been traveling through the forest ….

  16. Rashomon – What is Truth? When, all of a sudden,

  17. Rashomon – What is Truth? When, all of a sudden, they are confronted by Tajomaru, who halts their progress ….

  18. Rashomon – What is Truth? The nobleman and bandit go off alone into a thicket, where the former winds up being subdued by the latter

  19. Rashomon – What is Truth? The nobleman is tied to a tree and forced to watch as his wife is violated by the bandit

  20. Rashomon – What is Truth? The wife, at first, resists ….

  21. Rashomon – What is Truth? But eventually drops the dagger and submits

  22. Rashomon – What is Truth? So far, all parties concerned agree (roughly) as to the course of events, but from this point on the picture becomes murky, with each participant telling a somewhat different version of the story

  23. Rashomon – What is Truth? In two versions (Tajomaru’s and the woodcutter’s) the wife insists that her husband and the bandit fight for her honor. The nobleman’s death results from losing the duel.

  24. Rashomon – What is Truth? In the wife’s version, the bandit departs, with the husband still tied to the tree. The husband proceeds to taunt his wife, telling her how ashamed he is – of her!

  25. Rashomon – What is Truth? She cuts the rope binding her husband to the tree and asks to be killed! The wife promptly faints and when she awakens, finds the dagger in the chest of her (now very dead) husband

  26. Rashomon – What is Truth? In yet another version (the husband’s through a spirit medium) his wife betrays him and tries to convince the bandit to kill the husband

  27. Rashomon – What is Truth? However, the bandit is repulsed by this suggestion and quickly departs ….

  28. Rashomon – What is Truth? However, the bandit is repulsed by this suggestion and quickly departs …. The nobleman, still tied to the tree, picks up the dagger and plunges it into his chest, thus taking his own life

  29. Rashomon – What is Truth? However, the bandit is repulsed by this suggestion and quickly departs …. The nobleman, still tied to the tree, picks up the dagger and plunges it into his chest, thus taking his own life Some time later the (now very dead) nobleman is aware of someone (it is not clear who) removing the dagger from his chest

  30. Rashomon – What is Truth? The film ends as the priest, woodcutter and peasant mull over the significance of the disparate accounts of the nobleman’s death, seeking some kernel of truth in the morass of ambiguity and uncertainty

  31. Rashomon – What is Truth? The film ends as the priest, woodcutter and peasant mull over the significance of the disparate accounts of the nobleman’s death, seeking some kernel of truth in the morass of ambiguity and uncertainty It is unclear whether ANY witness has been entirely truthful

  32. Rashomon – What is Truth? The film ends as the priest, woodcutter and peasant mull over the significance of the disparate accounts of the nobleman’s death, seeking some kernel of truth in the morass of ambiguity and uncertainty It is unclear whether ANY witness has been entirely truthful (probably not)

  33. Rashomon – What is Truth? The story of Rashomon is cited often in philosophical discussions of “truth”

  34. Rashomon – What is Truth? The story of Rashomon is cited often in philosophical discussions of “truth” As nothing is known (or knowable) with absolute certainty, all knowledge is relative (and hence ephemeral)

  35. Rashomon – What is Truth? The story of Rashomon is cited often in philosophical discussions of “truth” As nothing is known (or knowable) with absolute certainty, all knowledge is relative (and hence ephemeral) The concept of truth is a chimera

  36. Rashomon – What is Truth? The story of Rashomon is cited often in philosophical discussions of “truth” As nothing is known (or knowable) with absolute certainty, all knowledge is relative (and hence ephemeral) The concept of truth is a chimera

  37. Rashomon – What is Truth? The story of Rashomon is cited often in philosophical discussions of “truth” As nothing is known (or knowable) with absolute certainty, all knowledge is relative (and hence ephemeral) The concept of truth is a chimera and therefore unworthy of pursuit

  38. Rashomon – What is Truth? Yet, there is an alternative interpretation, one that questions not the concept of truth itself, but rather the capacity of its assimilation through a single vantage point

  39. Rashomon – What is Truth? Yet, there is an alternative interpretation, one that questions not the concept of truth itself, but rather the capacity of its assimilation through a single vantage point Perhaps the “true” message of Rashomon is that deep and ever-lasting knowledge can only be gained through exposure to a variety of perspectives,

  40. Rashomon – What is Truth? Yet, there is an alternative interpretation, one that questions not the concept of truth itself, but rather the capacity of its assimilation through a single vantage point Perhaps the “true” message of Rashomon is that deep and ever-lasting knowledge can only be gained through exposure to a variety of perspectives, No single source providing sufficient depth and detail to comprehend a situation as complex (and as tragic) as the murder of a man

  41. Spoken Language – What is Truth? Can an intellectual domain as complex as spoken language be fully understood through the testimony of a single perspective?

  42. Spoken Language – What is Truth? Can an intellectual domain as complex as spoken language be fully understood through the testimony of a single perspective? Or must orthogonal varieties of evidence be sought with which to reconstruct the “truth”?

  43. Spoken Language – What is Truth? Can an intellectual domain as complex as spoken language be fully understood through the testimony of a single perspective? Or must orthogonal varieties of evidence be sought with which to reconstruct the “truth”? How does true insight proceed from “objective” study of spoken language?

  44. Spoken Language – What is Truth? Can an intellectual domain as complex as spoken language be fully understood through the testimony of a single perspective? Or must orthogonal varieties of evidence be sought with which to reconstruct the “truth”? How does true insight proceed from “objective” study of spoken language? Is it possible to fully comprehend the multivocal nature of a scientific domain from the sole vantage point of a laboratory?

  45. Spoken Language – What is Truth? Can an intellectual domain as complex as spoken language be fully understood through the testimony of a single perspective? Or must orthogonal varieties of evidence be sought with which to reconstruct the “truth”? How does true insight proceed from “objective” study of spoken language? Is it possible to fully comprehend the multivocal nature of a scientific domain from the sole vantage point of a laboratory? Or does the spirit of Rashomon compel us to seek testimony from other sources in the pursuit of objective knowledge?

  46. Part Two THE VARIETIES OF SCIENTIFIC EXPERIENCE The Fundamental Duality The Eternal Pentangle The Inner Triangle

  47. The Fundamental Duality Technology and science appear to oppose each other in perspective

  48. The Fundamental Duality Technology and science appear to oppose each other in perspective • Technology is concerned with what works • The Art of the Workable

  49. The Fundamental Duality Technology and science appear to oppose each other in perspective • Technology is concerned with what works (and can sell) • The Art of the Sellable • The Art of the Workable

  50. The Fundamental Duality Technology and science appear to oppose each other in perspective • Technology is concerned with what works (and can sell) • Science is concerned with what is • The Art of the Sellable • The Art of the Workable • The Art of the Soluble

More Related