1 / 18

Speech Data Corpus for Verbal Intelligence Estimation

Speech Data Corpus for Verbal Intelligence Estimation. Kseniya Zablotskaya , Steffen Walter, Wolfgang Minker. Outline. Introduction Improvement of Spoken Language Dialogue Systems Verbal Intelligence Estimation Monologues Collection Hamburg Wechsler Intelligence Test

neve-robbins
Download Presentation

Speech Data Corpus for Verbal Intelligence Estimation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Speech Data Corpus for Verbal Intelligence Estimation KseniyaZablotskaya, Steffen Walter, Wolfgang Minker

  2. Outline Introduction Improvement of Spoken Language Dialogue Systems Verbal Intelligence Estimation Monologues Collection Hamburg Wechsler Intelligence Test Dialogues Collection Transcription Standards Result Table for Each Candidate Participants Conclusions and Future Work

  3. Introduction Different ways to describe the same event: - “Excuse me, could you tell me the way to the railway station?” - “Hey you, show me where the railway station is.” What our words can say about us: Emotion Gender Age Analysis of speech Social class Personality Verbal Intelligence …

  4. Improvement ofSpoken Language Dialogue Systems - estimation of cognitive processes of the user - adaptation to the user Cognitive processes of the user Spoken language dialogue system Acoustic front-end Speech recognition Linguistic analysis Dialogue management Application Speech synthesis Text generation Adaptation to the user

  5. Verbal Intelligence Estimation Dialogues Monologues VI=120 VI=120 VI=120 VI=80 VI=105 VI=120 VI=105 VI=80 Transcribed speech VIMod Feature extraction Model / Classifier % Evaluation VI-test VI

  6. Monologues Collection Two short films (Galileo): Craziest hotels in the world: necessary to memorize the names necessary to memorize the order Experiment on how long people could stay awake possible to describe the film without certain details descriptions are informative

  7. Dialogues Collection Duration: at least 10 minutes Topic: the education and the school system in Germany - interesting - participants know a lot about it - participants have different opinions Dialogues Answering Questions Discussions Contra-Discussions

  8. Hamburg Wechsler Intelligence Test Information (25 questions) measures general knowledge questions from a particular culture For example: Who is president of Russia?

  9. Hamburg Wechsler Intelligence Test Comprehension (10 questions) social awareness common-sense For example: What would you do if you lost your way in a forest?

  10. Hamburg Wechsler Intelligence Test Digital Span forward backward auditory short memory concentration attention For example: Please listen to the fallowing digits and repeat them: 5 7 2 4 6

  11. Hamburg Wechsler Intelligence Test Arithmetic (10 questions) mental alertness attention and concentration while manipulation mental mathematical problems For example: Seven envelopes cost twenty five cents. How many envelopes can you buy if you have one dollar?

  12. Hamburg Wechsler Intelligence Test Similarities in Dissimilar Objects (12 questions) abstract reasoning power of conceptualization For example: Please find a similarity among a dog and a lion?

  13. Hamburg Wechsler Intelligence Test Vocabulary (42 questions) comprehension of meanings relation between the expressive words For example: What does the word “zebra” mean?

  14. Transcription Standards “?” – interrogative word intonation and rising tone “.” – completed thoughts and falling tone “,” – short pauses in the speech, but with a continuation of the main idea “;” – interrupted thoughts Example: “no no. or yes? you say; understand,” All monologues and dialogues were transcribed according to the standards by Mergenthaler. The punctuation marks in transcripts are used to show rhythmical and syntactical speech interruptions:

  15. Result Table for Each Candidate - candidate’s points for each verbal task and the verbal IQ. - verbal IQ is measured according to the special tables of the HAWIE.

  16. Participants 56 candidates: men - 27, women - 29 Age: 16 – 75 Language: German 71 monologues (3 hours 30 minutes) 30 dialogues (6 hours 30 minutes)

  17. Conclusions and future directions • Speech data corpus: • - 56 candidates; • - 10 hours of audio data; • Approaches which can be applied to the collected data: • - Word usage, abstracts, emotion words; • - Analysis at different linguistic levels: morphology, lexicology, syntax, semantics, and discourse; • - Linguistic styles; • - Content words; • - Degree of speakers’ immersion in monologues and dialogues; • - “Good story” criteria; • - Status in a conversation; • - Levels of agreement; • Kelly’s repertory grids; • We are going to find more candidates and to continue these recordings.

  18. Thanks for your attention!

More Related