Getting at variation with ultrasound: Scottish and Dutch /r/

1. Getting at variation with ultrasound: Scottish and Dutch /r/ Ultrafest 3University of Arizona at Tucson 14-16 April 2005 James M Scobbie (QMUC)Koen Sebregts (Utrecht)and thanks also esp. toAlan Wrench and Yolanda Vasquez Alvarez

2. Why /r/? Why ultrasound? • Previous articulatory studies of /r/ • There is a lot of variation • Variation, change, acquisition, phonetics • “labiodentalisation” of /r/ in Anglo English • “vocalisation” of final /r/ in Scottish English • “retroflexion” of final /r/ in Dutch • Phonology – what *is* an /r/ anyway? • Ultrasound • Relatively informal • Can provide dynamic images

3. Can we add to MRI? • Tiede’s beautiful images (from ICPhS 03)

4. Can we add to MRI? • And perhaps what we can expect…

5. Can we add to MRI? • And perhaps what we can expect…

6. Can we add to MRI? • Tiede’s beautiful images (from ICPhS 03)

7. Problems with ultrasound • The usual • Incomplete images, no passive articulator • Head-probe correction or control • Synchronisation and low frame rate • Splines and edges • Stats • plus… • European video output (PAL) is at 25Hz (albeit with more pixels, esp in raw AVI) • Fieldwork taped data is slower to prepare

8. Data collection – the laboratory • Good • Helmet (or other head games) • Less environmental noise • The experimenter is in control • Choice of equipment and software - demo • but… • Willing and normal subjects have to be found • Experiment costs • Intimidation of subjects

9. Data collection – the “field” • In this case – Glasgow Science Centre • Good • Lots of varied and willing subjects • Outreach… and publicity (!) • Vernacular speech more elicitable • Qualitative articulatory transcription - demo • but… • Things are a little out of control (cf feedback) • Small amount of time for each subject • Non-ideal equipment and methodology

10. What do we want for /r/? • Varied vowel environments • Varied word and syllabic positions • Acoustic analysis (and other channels?) • Info on multiple articulators • Stratified pool of subjects • Normal vernacular speech • Dynamics • Synchronised data

11. Backstep: methodological issues • Smearing of raw data due to scan rate • Creating of video output - downsampling and synchronisation problems

12. What’s the delay? Image processing Matrix of raw data Buffer of image data Smooth greyscale image buffer i.e. video output Video scanning Buffer of image data Matrix of raw data generated at the scan rate of the ultrasound machine e.g 72 complete scans per second

13. Methodological issues • There is always a delay • Our range was 20ms to 100ms (mean 40ms) • Does our 25Hz rate make it clearer or worse? • Practicalities • Multichannel synchonisation, even video, even acoustics, is based on unpredicatable delay whether via camcorder or direct • Individual video frames can be arbitrarily split in addition to overlay and interlacing • High ultrasound sample rate alone is not enough

14. Scottish background • Field work in Glasgow Science Centre • Stuart-Smith et al discover heavily retracted coda /r/ in young (teenage) vernacular Scots • Not “vocalisation” like middle class Anglification • Strong breaking (transitioning) with limited time at target? • Different target? • Limited evidence of mergers (yet)

15. Scottish pilot • Methodological • Probability of numerous subjects (hundreds) • All age groups, wide spectrum of social mix • Handheld probe plus mike mix to tape • Eyeball qualitative analysis is highly feasible • Need lab-based follow-up for quantitative research • Descriptive so far (very sketchy!) • Clear and obvious cases of pharyngeal /r/ • No meta-linguistic awareness of change

16. Scottish hypotheses & implications • Strong breaking in coda is a strong pharyngeal or tongue dorsal gesture • Some speakers have lost any obvious anterior gesture in coda • Anterior gestures, if present, include retroflex and bunched types of /r/ • This is socially stratified • There should be intra-speaker variation too • How categorical are these variations? • We need representative dynamic data

17. Dutch background • Large sociolinguistic, phonetic and phonological survey of Dutch (van Hout, Zonneveld and Van der Velde) • 400 subjects in multiple locations in Netherlands • Some speakers have uvular trill/fricative /r/ in onset, and an anterior approximant in codas • What is going on articulatorily? • What is the inter-speaker sub-variation like?

18. Dutch study • Subjects • 10 – all in Edinburgh • Post-screened down to 4 anterior /r/ users • Materials and protocol • Picture naming (n < 30) • Real words, near minimal pairs: /ir/ /ur/ /ar/ • Singleton /r/ and cluster /r/ and /r/-less • 3 reps • Feedback • Unaware of focus on /r/

19. Dutch study • Target – it’s a multi gestural thing • How do we choose the right frame for /r/? • Using acoustics needs good synchronisation • Using the images themselves is circular • Intergestural timing at 25Hz? • Dynamics • How to characterise? • Acoustics • Same sort of questions – target & dynamics • Final devoicing…

20. Boer MS – point is red at end of voice – tip down

21. Boer 1 RB

22. Boer 2 RB

23. Boer 3 RB

24. Mier 1 RB

25. Mier 2 RB

26. Mier 3 RB

27. Schaar 1 RB

28. Schaar 2 RB

29. Schaar 3 RB

30. Boer 2 RB

31. boer 2 vdl

32. boer 2 VDB

33. boer 2 MS

34. So far • Visual inspection of raw images or dynamic spline diagrams • Two retroflexers (RB VDL) • Two bunchers (MS VDB)

35. Next • Acoustic identification of an r phase • Midpoint spline can be extracted • No discrimination of voiced or voiceless • Identification of single “max rhotic” is similar • Acoustic analysis • Steady-state V + transition + r-phase • Location of end of voicing • F2 & F3 of voiced (usually) r target if obvious

36. MS bunched mainly voiced

37. VDB bunched mainly voiced

38. RB retroflex mainly voiceless

39. VDL… retroflex-ish but nearly vocalised?

40. VDL… real non-rhotic vowels for comparison boer vs. koe mier vs. riem schaar vs. sla

41. Dutch summary • 4 speakers with anterior coda /r/ • Two retroflex • Two bunch • One of the retroflex speakers is gradiently vocalising • Timing the /r/ late before pause • But some long domain cues in vowel quality and consonant variation • RB has strong transitions too rather than steady state but ?? sounds more rhotic • Interesting to look at following C…

42. Overall summary • Dutch anterior /r/ has various flavours • Retroflex • Non-retroflex • Weakened and late pre-pausal gesture • Glasgow /r/ comes in various flavours • Pharyngeal approximant observed • Breaking taking over from “rhoticity” • Strong phonetic effects • Vulnerable non-standard speech • Socially-stratified qualitative UTI is T.o.C.

43. Conclusions, implications • Weakening of final /r/ is flexible • Multiple articulators provide lots of options • Strength and timing are affected • Effects can be gradient and/or categorical • Acoustic effects appear complex • Phonological contrasts need not be affected • Small (?) sub-phonemic effects, change, and variation go hand-in-hand • Fine detail and structured variation are in the grammar

44. Methodology – field solution • Splines and edges lose a lot of info • Relative to MRI X-ray etc • Relative to ultrasound images • Qualitative analysis of images usefully augments impressionistic transcription • This can be done live and/or from tapes made in the field • Small amounts of data from large numbers of subjects is standard practice

45. Methodology: lab solution #1 • Dedicated hardware + software in the lab Matrix of raw data time stamped at headline sample rate (100Hz) Image processing Audio etc Time stamped PC buffer & files Start • High speed, synchronised, clean images • Integrated analysis (spline fit, export etc)

46. Methodology: lab solution #2 • Multichannel backbone (incl 200Hz EPG) • Funding application submitted • 100Hz synchronised machine (+ EPG) • Multichannel developments (EMA, VICON) • Helmet improvements • Also, funding application submitted for ultrafest 5 (2007)

47. Holiday report • Excellent!