1 / 17

Text generators, error analysis and feedback

Text generators, error analysis and feedback. Juan Rafael Zamorano Mansilla Universität Bremen. Introduction. Part of a three-year project: “Exploration of the applications of text generators in language learning”

trula
Download Presentation

Text generators, error analysis and feedback

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Text generators, error analysis and feedback Juan Rafael Zamorano Mansilla Universität Bremen

  2. Introduction • Part of a three-year project: “Exploration of the applications of text generators in language learning” • Generator used: KPML (Komet Penman Multilingual), University of Bremen. http://www.fb10.uni-bremen.de/anglistik/langpro/kpml/README.html • Project outcome: the Exercise Manager, a tool for the automatic generation of language exercises InSTIL/ICALL 2004 Symposium

  3. Purpose of the talk • Description of how the grammatical resources contained in KPML can be used for error analysis and the results they provide InSTIL/ICALL 2004 Symposium

  4. Information about the results obtained to present • Restricted to fill-in-the-blank exercises • Exercises from English and Spanish coursebooks • Initial tests, no real learners or teachers involved (tests with learners planned for winter semester 2004-05) InSTIL/ICALL 2004 Symposium

  5. Overview of KPML • Systemic-functional grammar: network of meaningful choices connected to realizations (Fig. 1) InSTIL/ICALL 2004 Symposium

  6. InSTIL/ICALL 2004 Symposium

  7. Overview of KPML • Storage of lexical items (Fig. 2) InSTIL/ICALL 2004 Symposium

  8. The algorithm for the detection of errors. General working principles • It tries to determine the grammatical features that differentiate the right answer from the user’s input • The result is a pair of grammatical features in meaningful opposition. One corresponds to the right answer, the other to the user’s input InSTIL/ICALL 2004 Symposium

  9. The algorithm for the detection of errors. Example • He got married ___ 1985 • Collection of features for in 1985: (groups-phrases prepositional-phrase nonwh-phrase prepositional-phrase-simplex minirange-thing spatio-temporal-process location-process temporal-process unordered strong-inclusive) InSTIL/ICALL 2004 Symposium

  10. Example • User’s input: on • Who can lexify on: weak-inclusion, on • Show path to... • Weak-inclusion (temporal-process location-process prepositional-phrase groups-phrases spatio-temporal-process unordered weak-inclusion) 5 features in common • On (spatial-process rest-process nonorientation-axis prepositional-phrase groups-phrases spatio-temporal-process location-process one-two-dimensions) 4 features in common InSTIL/ICALL 2004 Symposium

  11. Example • Divergent features in meaningful opposition: • ON: (temporal-process location-process prepositional-phrase groups-phrases spatio-temporal-process unordered weak-inclusion) • IN: (groups-phrases prepositional-phrase nonwh-phrase prepositional-phrase-simplex minirange-thing spatio-temporal-process location-process temporal-process unordered strong-inclusive) Fig. 5 InSTIL/ICALL 2004 Symposium

  12. InSTIL/ICALL 2004 Symposium

  13. Examples of diagnosisEXERCISES BASED ON LEXICAL CHOICE InSTIL/ICALL 2004 Symposium

  14. Examples of diagnosisEXERCISES BASED ON INFLEXION InSTIL/ICALL 2004 Symposium

  15. Examples of diagnosisEXERCISES BASED ON LEXICAL CHOICE AND INFLEXION InSTIL/ICALL 2004 Symposium

  16. Examples of feedback from the features obtained • Negative: “The preposition you need does not express motion” • Positive: “The preposition you need is used with three dimensional objects” • Contrastive: “You used the third person of the verb, but the context requires the second person” InSTIL/ICALL 2004 Symposium

  17. Conclusions and future work • Adequacy of systemic-functional generators for error diagnosis • Possibility of covering a wide range of errors with a single algorithm - no need to write lists of anticipated errors • Future work: • extend analysis to complete sentences • detect errors that are not grammar-based • detect errors resulting from transfer InSTIL/ICALL 2004 Symposium

More Related