10 MAR 2007

1. SEQUOYAHForeign Language Translation System 10 MAR 2007 MAJ Tracy Blocker/Dr Ed Cerutti US Army Intelligence Center Everrett.blocker@hua.army.mil and/or Edward.Cerutti@us.army.mil Tel (520) 538-0921/1479

2. Agenda • Sequoyah Overview/Strategy • Sequoyah Status • Concept • Sequoyah Team • Sequoyah Components and Current Technologies • TRADOC Capability Manager Direction • Way Ahead

3. What Is It?Sequoyah Overview • DOD Program of Joint Interest: Overarching program for Machine Language Translation (MLT) with Army as the Executive Agent. • PURPOSE: Identify current and developing technologies to meet warfighter requirements for foreign language support where MLT is an appropriate tool providing: • Automated 1 way and 2 way speech to speech (S2S) translation • Automated speech to text (S2T) translation • Automated 1 way and 2 way text to text translation (T2T) • Automated text to speech (T2S) translation • DOMAINS: Language data focused on specific military functions and paramaters • Warfighter (Force protection, Checkpoint ops, Convoy ops, Urban combat ops, Tactical Questioning, etc) • Internment and Resettlement • Foreign Soldier and Security Force Training • Medical • Maritime Interdiction Ops • Others…. • OBJECTIVE: MLT capability embedded in other systems (Soldier as a System [SaaS], Future Combat Systems [FCS], Distributed Common Ground System [DCGS], Deployable Joint Command and Control [DJC2], …) providing automated capability to meet the warfighters’ foreign language translation needs when a human linguist is unavailable.

4. SEQUOYAH Description • Overarching DoD program for machine language translation (MLT), with Army as the Lead Service, to develop technologies to meet Warfighter foreign language translation requirements when a human linguist is not available • Objective is a MLT capability embedded in other systems to include Joint Command and Control, DCGS (all services), SaaS, FCS, Prophet, and others • Key Participants: national Technical Support Workgroup, ODNI, JFCOM, DARPA, Service Labs, Defense Language Institute, PM Prophet, Army Intelligence Center and School Voice Response Translator Phraselator Coalition Chatline Plus Deployed at COCOMs, Navy, State Dept Speech to Speech System Broadcast Transcription and Translation Deployed at COCOMs Characteristics supporting Current and Future Force • One-way and two-way Speech Translation Capability when human linguist is not available • Force Protection Operations • Checkpoint Operations • Civil Affairs Operations • Medical Support • Detainee and EPW Operations • Intelligence Support • Two-way text translation capability for documents and communication over GIG • Internet and satellite broadcast transcription and translation Benefits/Capabilities • Greatly increase points of presence for foreign language translation capabilities on the battlefield • Enable communications with foreign speakers when human linguist is not available, enhancing mission success with • Host Nation • Coalition partners • Indigenous people • Enable rapid translations and triage of documents and media focusing analysts on most important and priority documents/media for exploitation

5. Provides an automated two way speech and text language translation capability through • Web enabled services (GIG) • Mobile (computing platforms) • Portable (handheld computing platforms) • Integrated seamlessly into other systems/programs (DJC2, Net-Enabled Command Capability, FCS, SaaS, DCGS, Prophet, etc) • Capability will be resident in/at • All DoD mission sets (Force protection, civil affairs, legal, medical, intelligence, etc) • Strategic level down to the individual warfighter • Embedded throughout DoD • Translation support for languages on DoD language priority list (Linguists required – human linguists available=Machines language translations systems) • Enables basic to intermediate proficiency machine language translation capability commensurate with mission requirements • Provides language translation modules for immediate download from a central repository • Provides warfighters the ability to update and tailor system to local mission requirements • Provides help desk services to assist with language modules, updates and other software integration issues CONOPS / OV-1 APOD: Aerial Port of Debarkation SPOD: Sea Port of Debarkation

6. Lessons Learned User Feedback Sequoyah Transition MGT OfficeOrganization Program Oversight Program Management Requirements Business Mgt. Engineering Prophet TestBed ARL USAIC&FH Program Transition S2S Programs Joint Requirements Oversight Research & Development Technology Dev. & Integration Joint Interoperability • Rapid Response • Sustainment • Tech. Refresh • Program Plan • Transition Pans/ • Agreements • PEO coordination • Advanced Systems • Supporting Tech • Tech Roadmap • Prototype Dev • R&D Coordination • C4ISR • Joint IERs • Service component • liaison • COCOM liaison • Other Gov’t Agencies • USD AT&L liaison • Software • Hardware • Tech Assessment T2T Programs Contracts & Purchasing • Rapid Response • Sustainment • Tech. Test & Evaluation • MOU, MOAs • Purchase • Agreements • SOWs • Assessments • Test Procedures • Technology Verif • TRL Evaluations Standards DOTMLPF Integration Language Requirements S2T, T2S, T2T Subordinate tech • Metrics • Data Procedures • Process Improvement • Data Verification • Joint Doctrine Dev • Joint Training Dev Budget & Accounting • Foreign language • committee • Service SLAs • DLI Liaison • Academia Interface • Rapid Response • Sustainment • Tech. Refresh Plans & Scheduling Joint Coalition Task Force Logistics Data Collection & Verification • Rapid Response • Sustainment • Tech Refresh Formal Acquisition Documents • Safety • Material release • Mission Sets • Domain Creation • Archives • Data Verification • RDEC • ARL • DARPA • NRL • AFRL

7. Current JFCOM/Sequoyah MLT Efforts • One-Way Speech Translation Systems • P2 Phraselator • Voice Response Translator • Other products • English-Iraqi Two-Way Speech (IS2S) Translation System • Leverages off of DARPA TRANSTAC Program: six developers • System and Operational Assessments in process • Coalition Chat Line + • Text to Text translation for coalition operations with soft copy input • T2T translation for soft copy documents • Broadcast Transcription and Translation • Speech to Text translation of television broadcasts in Modern Standard Arabic, Spanish and Chinese • Provides transcription in target language and translation in English synchronized with video • DOCEX (currently supported by NGIC) • T2T translation with paper input for 60+ languages • MLT only a portion of system capability

8. Coalition Chat Line Plus (CCL+)Sequoyah Record of Success • Exercise Support: Combined Endeavor 03 & 04, BALTOPS 03, & Rescuer/MEDCEUR 03 • OIF Support: Multi-National Division Center South-Iraq (Camp Babylon, Al Hillah, Karbala, Ad Diwaniyah, & Al Kut) • Combatant Command Use of CCL+: SOUTHCOM, EUCOM & PACOM • Languages Supported: English, German, Dutch, Spanish, Portuguese, Italian, French, Russion, Polish, Ukrainian, Korean, Japanese, Chinese, Thai, Arabic, Hebrew, Bahasa, Indonesia, Farsi Path Ahead • Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR • Further Testing and Improvement • Resident Capability: CENTRIXS • Languages To Be Added: Dari, Romanian, Turkish, Improved Thai • Description: Embedded Microsoft capability to collaborate and share electronic documents with coalition and ally nations in translated text to text that is nearly instantaneous. Bi-directional translation engines are used for capability (primarily SYSTRAN commercial vendor, but other vendors are available depending on supported language). • Key Participants: JFCOM, SPAWAR-San Diego (US Navy), CERDEC C2D, PM Prophet, S-TMO, FT Huachuca

9. Fielded T2T Systems Coalition Chat Line Plus CCL(+) Chat Room Participants Text Entry Area

10. Broadcast Transcription and TranslationSequoyah Record of Success • Available for use now • CENTOM J2 OSINT Section, JIOC: Arabic WEB and TV monitoring • Asst Secretary of Defense for International Security Affairs: Arabic TV monitoring • PSYOP TF 15, MNC-I: Arabic TV monitoring • SOCOM Joint Interagency Collaboration Center: R&D Pilot for advanced information retrieval CONOPS development • National Virtual Translation Center: R&D Pilot for support of human translation and language learning Path Ahead • Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR • Description: Real-time tracking and translation of broadcast media to include video, audio, internet, and other electronic media. Language Translation and Data Storage is integrated with analyst tools to correlate information and develop Intelligence Products for strategic or tactical use. • Key Participants: JFCOM, DARPA, Service Labs, PM Prophet, S-TMO, FT Huachuca

11. Voice Response TranslatorSequoyah Record of Success • Over 400 systems deployed • More systems ordered Path Ahead • Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR • Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier speaks basic words/phrases into system and words/phrases are translated into target language. • Key Participants: JFCOM, Service Labs, PM Prophet, S-TMO, FT Huachuca

12. P2 Phraselator Sequoyah Record of Success • Over 1400 systems deployed • More systems ordered Path Ahead • Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR • Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier selects recorded phrase for the system to play in target language. • Key Participants: JFCOM, Service Labs, PM Prophet, S-TMO, FT Huachuca

13. English/Iraqi Speech to Speech TranslationSequoyah Record of Success • Testing in Iraq now Path Ahead • Pathway to Program of Record: Incorporated into the Sequoyah program as it progresses to POR • Complete testing and subsequent system modifications • Description: Handheld device allowing soldier basic 1 way speech to speech (1WS2S) foreign language communication based on common required phrases (mission oriented). Soldier speaks basic words/phrases into system and words/phrases are translated into target language. • Key Participants: JFCOM, DARPA, Service Labs, PM Prophet, S-TMO, FT Huachuca

14. Coordination with Pending TCMTRADOC Capability Manager Ground Sensor 1. Immediate funding of program to meet machine language translation requirements • Support OIF/OEF requirements • Support GWOT requirements • Preparation for future force requirements • Priority languages: Iraqi Arabic, MSA, Dari, Pashto, Farsi, Chinese, other languages as listed on Strategic Language List 2. Integrate proven Sequoyah capabilities to address current force machine language translation requirements (Joint Command and Control, DCGS, SaaS, FCS, Prophet, and others) 3. Accelerate RDT&E of Sequoyah Program • Development of translation data to support machine language translation software • Rapid assessment of “cutting edge” translation systems • Maturing the capabilities Priority Mission Sets: force protection, civil affairs, medical support, detainee and EPW ops, intelligence support, etc Typical Development of Specific Machine Language Translation Capability Timeline: 2 years YR 2 YR 1 Mature Capability Initial Capability Data Collection Data Preparation Initial Investment Development of Translation Capability (includes assessment)

15. Sequoyah Way Ahead • JCIDS (Joint Capabilities Integration and Development System) Process • CDD (Capabilities Development Document): AROC approved; Submitted to Joint Staffing on 9 FEB 07 • Possible MS B Decision in FY 09 or 10 • FUNDING: • Discussion/Coordination for 09-13 POM • Joint Forces Command and Office of the Secretary of Defense • Army Supplemental • ODNI Proposals • TESTBED: • Parallel Corpora Collections • Best of Breed Tests/Review • INTEGRATION: • Requirements Collection from Other Services and DoD Agencies • Coordination with DJC2, DCGS (all services), SaaS, FCS, Intel Systems • DEPLOYMENTS: Continued Deployments on promising technologies

16. ALWAYS OUT FRONT Always Engaged ! MAJ Tracy Blocker/Dr Ed Cerutti US Army Intelligence Center Everrett.blocker@hua.army.mil and/or Edward.Cerutti@us.army.mil Tel (520) 538-0921/1479

17. Broadcast Transcription Translation (BTT) Automatic translationof Arabic transcript from Language Weaver Automatic transcriptionof Arabic speech from BBN Audio Indexer Real-time streaming video(~5 min delay) 24” cubic container Power conditioner Monitor and keyboard Satellite receiver Servers for :Video encoding,Speech transcription,Language translation, Content management Fielded BTT Systems • Real-time Tracking and Translation of Broadcast Media: • Video: Television, Live and Recorded Video • Audio: Radio, Voice Recordings • Text: Electronic Media – Websites, E-mail • Graphic: OCR Input • Language Translation and Data Storage Integrated with Analyst Tools to Correlate Information and Develop Intelligence Products for Strategic or Tactical Use  • Network-ready, Scaleable, Ruggedized Capability, Deployable at Multiple Operational Echelons, Configurable to get Maximum Utility from Translator Resources Real-time Monitoring of Al-Jazeera eTAP-Arabic TV Processing Component