110 likes | 256 Views
eSIGN – HPSG-assisted Sign Language Composition. Thomas Hanke, Hortensia Popescu, Constanze Schmaling University of Hamburg, Inst. Of German Sign Language www.sign-lang.uni-hamburg.de. Sign Language & the European Deaf Community.
E N D
eSIGN – HPSG-assisted Sign Language Composition • Thomas Hanke, Hortensia Popescu, Constanze Schmaling • University of Hamburg, Inst. Of German Sign Language • www.sign-lang.uni-hamburg.de
Sign Language & the European Deaf Community • Sign language is the closest-to-native language for the Deaf community • 0.1% of the European population • No written form of sign language • Written language competence of many Deaf people poor • Bilingual education spreading slowly
Project Idea: Virtual Signing into eGovernment initiatives • Virtual Signing reduces bandwidth problems with digital video • Relatively easy=cheap and flexible production process • Ensures Deaf people’s integration into a key component of tomorrow’s Information Society (cf. anti-discrimination acts) • Multilingual focus: British Sign Language, Deutsche Gebärdensprache, Nederlandse Gebarentaal
Builds on ViSiCAST animation and language technology • Motion capture • Results in highest-quality animation • Compresses far better than video • Requires expensive equipment • Synthetic animation • More “robotic”, yet still easy to understand • Even lower data rates • More versatile
SiGML: XML application • <?xml version="1.0" encoding="UTF-8"?> • <!DOCTYPE sigml SYSTEM "http://www.visicast.org/sigml/SiGML_h4_10.dtd"> • <sigml> • <hamgestural_sign gloss="HAMBURG1B"> • <sign_manual> • <handconfig handshape="ceeall" mainbend="bent" ceeopening="slack"/> • <handconfig extfidir="ul"/> • <handconfig palmor="d"/> • <location_bodyarm location="forehead" side="right_beside" contact="close"/> • <par_motion> • <directedmotion direction="r"/> • <tgt_motion> • <changeposture/> • <handconfig handshape="pinchall" mainbend="bent"/> • </tgt_motion> • </par_motion> • </sign_manual> • </hamgestural_sign> • </sigml>
eSIGN Translation into Sign Language • Have a signed sentence in mind • Pick signs one-by-one from lexicon • Current lexicon size: 6500 entries • Modify parameters if defaults don’t apply • Immediately view the sentence signed by the avatar
HPSG Lexicon: Different kinds of entries • Invariable: HamNoSys fully specified
Lexicon • Variable: HamNoSys only partially specified: to be inferred
Outlook • HPSG grammar to be used to suggest most likely unifications