290 likes | 365 Views
The Benefits of Modelling Language Production Interactively. Dr. Ulrich Schade Forschungsgesellschaft für Angewandte Naturwissenschaft e.V. Wachtberg / Bonn. Structure of the Talk. Model Competition Phonological Encoding Grammatical Encoding Interactive Processing
E N D
The Benefits of Modelling Language Production Interactively Dr. Ulrich Schade Forschungsgesellschaft für Angewandte Naturwissenschaft e.V. Wachtberg / Bonn Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Structure of the Talk • Model Competition • Phonological Encoding • Grammatical Encoding • Interactive Processing • the “principle of varying interactivity” • the benefits of modelling interactively Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Milestones in Language Production Modelling Zenon of Kition (334-262 B.C.). Pick (1913). Die agrammatischen Sprachstörungen. Fromkin (1971). The non-anomalous nature of anomalous utterances. Garrett (1975). The analysis of sentence production. Bock (1982). Toward a cognitive psychology of syntax. Kempen & Hoenkamp (1987). An incremental procedural grammar for sentence formulation. Levelt (1989). Speaking. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Model Competition Levelt’s Speaking is the centre for reference in the field. But scientific progress also needs the challenge of competition. The most influential competitor of the Levelt model is Dell’s interactive model. Dell (1986). A spreading-activation theory of retrieval in sentence production. Psychological Review, 93, 283-321. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Model Competition Dell’s model is especially well-suited for explaining error data. E.g., it offers a new perspective on exchange errors and explains the fact that the distance between target and error element is shorter in exchange errors than in anticipation errors. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Levelt et al. postulated an elaborated “classical” model for the process of lexical of access which includes the process of phonological encoding. Levelt, Roelofs & Meyer (1999). Lexical access in speech production. Behavioral and Brain Sciences, 22, 1-75. However, their model fails to account for basic facts about errors, e.g., the existence of exchange errors and the syllable position effect. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Error Type Anticipation Gad Godesberg 75% 80% Perseveration Bad Bodesberg 20% 20% Exchange Error Gad Bodesberg 5% 0% Error distribution according to Nooteboom (1969). Error distribution according to WEAVER. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Error Type Anticipation Gad Godesberg + 75% 80% Gad eh Bad Godesberg Perseveration Bad Bodesberg 20% 20% Exchange Error Gad Bodesberg 5% 0% Error distribution according to Nooteboom (1969). Error distribution according to WEAVER. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Error Type Anticipation Gad Godesberg + 75% 80% Gad eh Bad Godesberg Perseveration Bad Bodesberg 20% 20% Exchange Error Gad Bodesberg 5% 0% Error distribution according to Nooteboom (1969). Error distribution according to WEAVER. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Error distribution according to Nooteboom (2003). Listening to oneself: Monitoring speech production. (http://www.let.uu.nl/~Sieb.Nooteboom/personal/monitor.pdf) Anticipations 34.52%80% Perseverations 22.20%20% Exchange Errors 43.28%0% WEAVER Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding The syllable position effect can be explained by frame-based production. There is evidence for this kind of production at different production levels. With respect to the morpheme level, see morpheme strandings: “I hate working on two-wordletters.” “It just sounded to start.” “Oh, that is just a backtrucking out.” “I´m not in the read for mooding.” Examples by Garrett (1975). Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Frame-based production would attend to sequentialization, Landung N land- -ung Stem+Suffix C-V-C—C-V-C /l/ /a/ /n/ /d/ /u/ /ŋ/ Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Landung N land- -ung Stem+Suffix C-V-C—C-V-C /l/ /a/ /n/ /d/ /u/ /ŋ/ C - V - C --- C - V - C Phonological Encoding Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding but Levelt et al. deny frame-based sequentialization. Landung N land- -ung Stem+Suffix C-V-C—C-V-C /l/ /a/ /n/ /d/ /u/ /ŋ/ C - V - C --- C - V - C Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
syn_cat Landung N land- -ung 1 2 3 4 1 2 /l/ /a/ /n/ /d/ /u/ /ŋ/ C - V - C --- C - V - C Phonological Encoding They use labeled connections, instead, Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding in order to explain how it is possible to connect words violating word and syllable borders: escort us -skor´-t s However, this approach also means that the syllable position effect is not covered anymore. Consequently, Levelt et al. (1999, p. 21) challenged the effect (with respect to English and Dutch, but not to German and Spanish). e e Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Vousden, Brown, & Harley, (2000). Serial control of phonology in speech production. Cognitive Psychology, 41, 101-175. accepted the challenge and demonstrated the effect [with respect to English] once more. So, there is a dilemma which can be overcome by modelling interactively: Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Phonological Encoding Berg: “The phonemes themselves must be allowed to vote for the frame to be used.” Landung N land- -ung Stem+Suffix C-V-C—C-V-C /l/ /a/ /n/ /d/ /u/ /ŋ/ feedback C - V - C --- C - V - C Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding Connectionist models in the tradition of Dell’s model compete successfully with other models with respect to phonological encoding. However, with respect to grammatical encoding, classical models dominate. Particularly, with regard to some cases of recursion, connectionist models necessarily fail. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding E.g., our interactive model is not able to produce sentences which include a relative clause that is embedded in another relative clause. „Der großzügige Sponsor, der den berühmten Rennfahrer, den der geschickte Mechaniker so bewunderte, an seiner Box erfreut begrüßte, versprach, das gegnerische Team nicht länger zu unterstützen.“ Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding Typically, the model leaves out the closing of the outer relative clause: „Der großzügige Sponsor, der den berühmten Rennfahrer, den der geschickte Mechaniker so bewunderte, an seiner Box erfreut begrüßte, versprach, das gegnerische Team nicht länger zu unterstützen.“ Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding The behaviour of the model seduced us to run an experiment. Human speakers were asked to complete sentence beginnings like „Der großzügige Sponsor, der den berühmten Rennfahrer ...“ (R1 condition) and „Der großzügige Sponsor, der den berühmten Rennfahrer, den der geschickte Mechaniker ...“ (R2 condition) Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding Elisions Under Condition R2 Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding • 0 correct • Lex. Rep. Error • Synt. Rep. Error • Elision • Num. Agr. Error • Case Agr. Error • Abort • Repair • ~ correct Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding The most common syntax error made by the VPs corresponds to the model’s error. However, the VPs masked the errors by semantic means. „Der talentierte Fußballspieler, der den harten Trainer, der den schielenden Linienrichter zurechtgewiesen hatte, war vom Platz gestellt worden.“ “The talented soccer player who the rigorous trainer who the cross-eyed linesman reprehended had had from field expelled been.” Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Grammatical Encoding In this case, the benefit of modelling interactively had been that the model’s behaviour provoked an experiment which revealed some interesting facts about the cognitive process of language production. Please, cf. Schade, U., Barattelli, S., Lingnau, B., Hadelich, K. & Dipper, S. (2003). Relativsatzproduktion. Linguistische Berichte, 193, 33-55. for details. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Interactive Processing Interestingly, interactive models are on their best behaviour if a process which results in an error has to be modelled. The reason lies in the principle of varying interactivity: Interactive effects can be demonstrated best in production under trouble. Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Interactive Processing + TARGET + Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie
Interactive Processing • The benefits of modelling language production interactively: • nice competitor • can account for erroneous production processes / results • has the“principle of varying interactivity” • has feedback voting for frames • (late syllabification and syllable position effect) Forschungsinstitut für Kommunikation, Informationsverarbeitung und Ergonomie