Presented by :M me Hala Bezine

1. Republic of Tunisia Ministery of Higher Education and Scientific Research University of Sfax National Engineering School of Sfax Tunisia ResearchGrouponIntelligentMachines Towards an Ink-Enabled handwriting editor Presented by :Mme Hala Bezine THE 15th INTERNATIONAL GRAPHONOMICS SOCIETY CONFERENCE (IGS2011) (IGS2011) Live Aqua Cancun, MEXICO Hala Bezine IGS 2011 Cancun-Mexico

2. Outline 1- Introduction 2- Technical specifications of the On-line database “Mayastroun” 3- Architecture of the developed handwriting editor interface 4- Conclusions Hala Bezine IGS 2011 Cancun-Mexico

3. 1- Introduction Ink-enabled handwriting editor • The human being wants to communicate with the computer in the simplest, fastest way in order to facilitate and accelerate the interaction and the exchange of information • He seeks to make these machines, able to read, see, move, treat and quickly analyze the information received • InkMLprovides cross-platforrmenvironement to support handwriting • InkMLoffers a common format for the excahnging data between component (handwriting, gesture recognition, signature verification… Hala Bezine IGS 2011 Cancun-Mexico

4. 2-Technicalspecifications of the On-line database “Mayastroun” • The input of the handwriting editor are handwritten scripts drawn on digitizingtablet and stored in “Mayastroun” • “Mayastroun” This dual handwritingdatabasecontains a variability of data : Arabic or Latin characters, digits, texts, signatures, mathematical expressions, etc.... • All samples are stored in XML (eXtensibleMarkupLanguage) files • Eachsample has twocomplementary Files : • .outextension for the on-line handwrittendatabase • .bmpextension for the off-linehandwrittendatabase. • A graphic user interface (GUI) wasdeveloped in .Net language Hala Bezine IGS 2011 Cancun-Mexico

5. Scripter identification Digital tablet XML file MAYASTROUN database 2-Technicalspecifications of the On-line database “Mayastroun” General Schema of the “Maystroroun ” database Hala Bezine IGS 2011 Cancun-Mexico

6. 2-Technicalspecifications of the On-line database “Mayastroun” • Each writer: • has an identifier number ID which will be used when acceding to the database • has a repertory is attributed to store all written samples • fills an electronic coordinate's form to collect personal information such as first and last name, date of birth, country, sex and other informations • “Mayastroun” contains: • 5000 isolated digits • >13036 isolated lower and upper case letters • 35017 isolated words from a 500 word lexicon (English, French and Arabic) Hala Bezine IGS 2011 Cancun-Mexico

7. 2-Technicalspecifications of the On-line database “Mayastroun” Example of XML file from the database “Mayastroun” Hala Bezine IGS 2011 Cancun-Mexico

8. 3- Architecture of the developed handwriting editor interface Based on the XML, XSLT is the language used for the conversion of files that have the same or other extensions The original document is not changed, but a new document is created based on the content of the existing one The new document will be arranged by the processor in standard XML syntax or in another format, such as HTML or text (Microsoft Word, Latex,...) Hala Bezine IGS 2011 Cancun-Mexico

9. 3- Architecture of the developed handwriting editor interface The Interface designed for conversion of the samples from the database Mayastroun with .net language Hala Bezine IGS 2011 Cancun-Mexico

10. 3- Architecture of the developed handwriting editor interface • Handwriting recognition: the process by which software analyzesinkwords to convertthem to typedtext • This recognition stage isbased on naturalhandwritingthatisdigitized by the system, thenmodifiedinto digital writingwhichis in turnanalysed by a recognition engine • This conversion isapplied via the menu "conversion" of the handwriting interface Hala Bezine IGS 2011 Cancun-Mexico

11. 3- Architecture of the developed handwriting editor interface The Handwriting editor interface Hala Bezine IGS 2011 Cancun-Mexico

12. 3- Architecture of the developed handwriting editor interface Good recognition rate are obtained for major editable texts • This editor iswellsuited for a broad range of applications and platforms • It is not restricted to handwritingsamplesfrom “Mayastroun” database, but wecan exploit othersdatabasessuch us Unipen,etc... • In practice and especially for pen-basedmathematical interfaces, someimprovements must betakenintoaccount in order to recognizemathematicalsymbols and each component embedded in significantmathematical expression Hala Bezine IGS 2011 Cancun-Mexico

13. 3- Architecture of the developed handwriting editor interface Good recognition rate of 98,27 (228 among 232 characters after recognition) An example of handwritten text edited by Microsoft Word Hala Bezine IGS 2011 Cancun-Mexico

14. 4- Conclusions A system for the real-time recognition of handwriting script “ An ink Enabled Handwriting Editor ” Recognition of every type of handwritten text expressed in Latin “ Satisfied recognition rates” Enhancement of the recognition performance of on-line Arabic script Hala Bezine IGS 2011 Cancun-Mexico

15. Thanks for your attention Contacts : {hala.bezine, sourour.njah, adel.alimi } @ieee.org REGIM: REsearch Group on Intelligent Machines, University of Sfax, National Engineering School of Sfax (ENIS), Tunisia Hala Bezine IGS 2011 Cancun-Mexico