1 / 100

Enhancing Instruction of Written East Asian Languages with Sketch Recognition-Based “Intelligent Language Workbook” Inte

Enhancing Instruction of Written East Asian Languages with Sketch Recognition-Based “Intelligent Language Workbook” Interfaces. Paul Taele & Tracy Hammond Sketch Recognition Lab Dept. of Computer Science & Engineering Texas A&M University. Introduction Related Work Methodology Interfaces

norman
Download Presentation

Enhancing Instruction of Written East Asian Languages with Sketch Recognition-Based “Intelligent Language Workbook” Inte

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Enhancing Instruction of Written East Asian Languages with Sketch Recognition-Based “Intelligent Language Workbook” Interfaces Paul Taele & Tracy Hammond Sketch Recognition Lab Dept. of Computer Science & Engineering Texas A&M University

  2. Introduction Related Work Methodology Interfaces Evaluation Upcoming Work Q&A Session

  3. <start>IntroductionRelated Work

  4. Learning East Asian languages

  5. Learning East Asian languages: Growing impact in international business

  6. Learning East Asian languages: Strong interest in pop culture trends

  7. Learning East Asian languages: Cultural and family heritage obligations

  8. Learning East Asian languages: Fulfill required foreign language requirement

  9. Difficulties of East Asian languages

  10. Components of East Asian language instruction

  11. Western (English) vs. East Asian (Chinese) scripts

  12. Difficulties of East Asian languages: Numerous symbols for certain scripts

  13. Difficulties of East Asian languages: Many strokes for more complex symbols

  14. Difficulties of East Asian languages: Strong similarities among symbols

  15. Difficulties of East Asian languages: Diverse writing variations in natural writing

  16. Difficulties of East Asian languages: Necessity of stroke order and direction

  17. Mobile Technologies

  18. Stylus-driven tablets e.g., classroom environments

  19. Stylus-driven monitors e.g., language lab environments

  20. Stylus-driven phablets e.g., outside-classroom environments

  21. Mobile Technologies + East Asian Language Instruction

  22. Intelligent Language Workbooks

  23. Intelligent Language Workbooks Paul Taele Chinese Language Tracy Hammond Lab Director Ross Peterson Japanese Language Stephanie Valentine General Sketching Ayden Kim Korean Language

  24. IntroductionRelated WorkMethodology

  25. Pedagogical Techniques

  26. Human Language Instructors: [+] expert knowledge, dynamic feedback

  27. Human Language Instructors: [-] scheduled availability, less personalized

  28. Paper-Based Language Workbooks: [+] guided writing practice

  29. Paper-Based Language Workbooks: [-] static and binary feedback

  30. Rote Writing Memorization: [+] brute force effectiveness

  31. Rote Writing Memorization: [-] repetitive, error-prone

  32. Computing Applications

  33. Flash card-driven mobile applications: [+] better streamlined [-] lacks writing engagement

  34. Touch-driven mobile applications: [+] improved interactive input [-] isolated from classroom and pure writing

  35. Related WorkMethodologyInterfaces

  36. Primary development tools

  37. 力 Corner-finding algorithms (e.g., Sezgin, PaleoSketch) Sketching language (i.e., LADDER) Automated recognition tools

  38. Desired features and corresponding tools

  39. components constraints aliases 十 古 口 LADDER Components

  40. components constraints aliases LADDER Constraints

  41. 口 components constraints aliases 十 kanji048 horzLine line1 mouth LADDER Aliases

  42. line orientation point orientation shape interaction LADDER convention for line orientation

  43. line orientation point orientation shape interaction center p1 p1 center p2 p2 LADDER convention for point orientation

  44. line orientation point orientation shape interaction LADDER convention for shape interaction

  45. 十 • Line • horzLine • Line • vertLine components Visual structure recognition on components

  46. Horizontal • horzLine • Vertical • vertLine line orientation Visual structure recognition on aliases

  47. Line line1 • horzLine • Line line2 • vertLine • Point start1 • vertLine.p1 • Point end1 • vertLine.p2 • Point start2 • horzLine.p1 • Point end2 • vertLine.p2 start2 line1 end1 start1 line2 end2 aliases Written technique recognition on aliases

  48. start2 Stroke Order? Stroke Direction? line2 line1 start2 start1 line2 start1 end1 line1 end2 Incorrect stroke order case

  49. start2 Stroke Order? Stroke Direction? line1 line2 end1 start2 line2 line1 start1 end1 end2 Incorrect stroke direction case

  50. MethodologyInterfacesEvaluation

More Related