190 likes | 360 Views
Sofia Strömbergsson, Jens Edlund & David House KTH Speech , Music and Hearing Stockholm, Sweden. Prosodic measurements and question types in the Spontal corpus of Swedish dialogues. VariQ. Investigate and describe intonational variation in questions in spontaneous dialogue .
E N D
Sofia Strömbergsson, Jens Edlund & David House KTH Speech, Music and Hearing Stockholm, Sweden Prosodic measurements and question types in the Spontal corpus of Swedish dialogues
VariQ Investigate and describe intonational variation in questions in spontaneousdialogue. Is there a standard typeofquestion intonation?
Question intonation • Declarative => Interrogative ”You like apples.” vs. ”You like apples?” • Different questiontypes, different intonation Y/N questions: Wh-questions: • Where is the rise in conversationalspeech?
Spontal corpus • 60 hoursofdialogue / 120 half-hour sessions • Talk freelyaboutanything
Questionextraction • 24 dialoguesubset (= 12 hours) • Talkspurts based on voice-activity/silence • Orthographictranscriptions • Twoannotators tag ”questions” 908 talkspurts withquestion tag 600selected (Spontal balance, 2+ annotatorsagreeing)
Questionmarkup • Q1: [Y/N] [Wh] [Alt’s] [Other] • Q2: [Required] [Optional] [Prohibited] • Q3: [Forward] [Backward] • Q4: [Reported] [Direct] Ser du attdetärhålibotten? Do you see there’s a hole in the bottom?
Questiontypes • Q1: • Q2: • Q3: • Q4: Y/N > Wh >> Alt’s & Other Required >> Optional > Prohibited Forward >> Backward Direct >> Reported
Prosodicmeasures TIME Duration Speech rate PITCH Variation Rising/Falling intonation DIFF: (Avg pitch)2ndHalf - (Avg pitch)1stHalf
Duration Is that Obama or Romney? • Significantdifferencesbetween (almost) all Q1 categories Is that Obama? Who’sthat? • Forward-directedquestionslonger
Speech rate • Otherareslower Is thattrue?! Didyou?! Oh yeah…? • Optionalareslower • Backwardareslower
Pitch variation • Morevaried pitch in questionstowhichanswersareOptional Is thattrue?! Didyou?! • Morevaried pitch in Backward-directedquestions • Reflectingattitude?
Rising/Falling intonation • Y/Nfalling, Whrising (or flat) • Forwardfalling, Backwardrising (or flat) – butlarge variation
Rising/Falling intonation (cont.) Jaha? Oh yeah? Tycker du inte? Don’t you think? Ärdetsant? Is that true? Vadsa du? What’d you say? Rising intonation signalling non-understanding/non-acceptance?
Conclusions • Strengthsofcodingscheme: • General • Quick-and-easy • Orthogonal, allowsclusteringacross different dimensions • Interplayacross different dimensions Optional + Backward Other + Optional + Backward More pitch variation Slower Attitude? Uncertainty? Non-agreement?
Questionmarkup • Q1: [Y/N] [Wh] [Alt’s] [Other] • Q2: [Required] [Optional] [Prohibited] • Q3: [Forward] [Backward] • Q4: [Reported] [Direct] Vadbetyderdet? What does that mean?
Rising/Falling intonation (cont.) • DIFF: Y/N falling, Wh rising; Backwardrising But… confusionwithsentence focus? • PROS: No significantdependencies…
Summary: Prosodicmeasures • Duration: Dependent on numberofalt’s • Speech rate: Slowreflectinguncertainty? • Pitch variation: Reflectingattitude? • Rising/Falling intonation: • DIFF: Dependent on sentence focus? • PROS: Not dependent on questiontype