100 likes | 236 Views
5 th Framework Program Key Actions:. Systems and services for citizen To meet the needs and expectations of European citizens for high quality and affordable services of general interest. RTD will be carried out in the fields of health , persons with special needs
E N D
5th Framework Program Key Actions: • Systems and services for citizen • To meet the needs and expectations of European • citizens for high quality and affordable services • of general interest. RTD will be carried out in the • fields of health, persons with special needs • (including elderly and disabled), administrations, • environment and transport. • Multimedia context and tools Duration: 36 months The ViSiCAST Project Virtual Signing: Capture, Animation, Storage & Transmission IST Programme -1999-10500
Information access and communication of pre-lingually deaf people Project statement Open choice Advanced technology-based No proprietary solutions
? Television access • Subtitles currently increase significantly TV streams • Those deaf from birth find it difficult to learn spoken • and written English • Signing is their natural language • English law requires to sign 2% by 2001, and 5% by 2009
? Television access Television access • A supporting MPEG-2 stream Human signer + additional channel Expensive solution • An insert into existing picture Data stream driving avatar
Deaf customer Counter clerk Sign Language Speech Face-to-face transactions ? Natural interaction Speech driven signing
Multimedia and WWW Applications Text-to-sign generator WWW pages Text driven signing
Specific Sensors Gesture Capture MPEG-4 Encoder BAPs Files DSs in MPEG-7 DL 3D Model-Based Analysis/Indexing MPEG-7 Encoder Signer HamNoSys Representation ViSiCAST GML Text Gesture MPEG-Decoder Notation HamNoSys- Based Avatar Animation BAPs/DS-Based Avatar Animation Speech World Knowledge Lexicon SL Grammar TV Signing Standards and Delivery Interactive Deaf Signing on the Web Face-to-Face Access to Services Low Bit-Rate Transmission P a r s i n g Services Synopsis of the ViSiCAST Project
Instituut voor Doven Hamburg University University of East Anglia Independent Television Commission Televirtual The Post Office Royal Institute for Deaf People Institut National des Télécommunications Institut für Rundfunktechnik TheViSiCASTConsortium
TheViSiCASTConsortium Experts in: • Speech and text translation into Sign Language (UEA) • Sign Language notation (UH) • Avatar creation (TV) • Broadcast technology (ITC, IRT) • Broadcast imaging and animation standards (INT) • Multimedia content creation (IvD) Face-to-Face transactions provided by the UK PO Evaluation capabilities provided by the UK RNID
MPEG-4 compliant avatar definition & animation DEMO MPEG-7 compliant sign language indexing ARTEMIS Contributions Virtual signer