1 / 13

A Feedback-Augmented Method for Detecting Errors in the Writing of Learners of English

A Feedback-Augmented Method for Detecting Errors in the Writing of Learners of English. Ryo Nagata et al. Hyogo University of Teacher Education ACL 2006. Objective. Detect singular-plural errors in English writing I ate a lot of chicken . I ate a lot of chickens. Approach.

umika
Download Presentation

A Feedback-Augmented Method for Detecting Errors in the Writing of Learners of English

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Feedback-Augmented Method for Detecting Errors in the Writing of Learners of English Ryo Nagata et al. Hyogo University of Teacher Education ACL 2006

  2. Objective • Detect singular-plural errors in English writing • I ate a lot of chicken. • I ate a lot of chickens.

  3. Approach • Learn a decision list to separate mass nouns from count nouns • The paper is made of hemp pulp. • I read the paper. • Check if the target noun has the correct form • singular or plural

  4. Decision List Training Corpus • British National Corpus • EDR Corpus • Instance format • She ate fried chicken/mass for dinner • Feature • Noun phrase components (e.g. fried) • Context words (e.g. she, ate, for, dinner) • Sample decision rules • eat-3 mass • frynp mass • for+3 mass • dinner+3 mass

  5. Ranking Decision Rules • Rank by log-likelihood ratio • Example

  6. Decision List Feedback Training Corpus • Use marked essays by English learners • More domain-specific • Three ways to use • Add into BNC and EDR corpora • Feedback corpus too small to affect p(MC|wc) • Increase weight of feedback corpus • Increase weight of feedback corpus even more

  7. Increasing the Weight of Feedback Corpus • Increase the weight of feedback corpus by statistical confidence

  8. Increasing the Weight of Feedback Corpus Even More • Take the log of the general corpus’ confidence

  9. Error Detection • Use decision list to determine whether a noun is mass or count • Step 1: Mass noun in plural form  error • Step 2:

  10. Error Detection (Cont.) • Step 3:

  11. Testing Corpus • 47 essays by Japanese English learners • 105 errors identified by professional English marker

  12. Experiment Result • DL: decision list • FB: add directly • fb1: increase weight by confidence • fb2: increase weight more

  13. Conclusion • Decision list better than rule-based and web-based methods • Feedback corpus better than general corpus only

More Related