1 / 21

XISL: Content-Independent, Device-Independent MMI Description Language

XISL: Content-Independent, Device-Independent MMI Description Language. Tsuneo Nitta Graduate School of Tech., Toyohashi Univ. of Tech. Issues on Interaction with Web. ■ The coming of heterogeneous devices

hada
Download Presentation

XISL: Content-Independent, Device-Independent MMI Description Language

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. XISL: Content-Independent, Device-Independent MMI Description Language Tsuneo Nitta Graduate School of Tech., Toyohashi Univ. of Tech.

  2. Issues on Interaction with Web ■ The coming of heterogeneous devices and interaction manner • access by : PC, Mobile phone, PDA, AutoPC, DTV, … • interaction with: modality-rich terminals, mixed initiative, ...

  3. Our Purpose: Seamless Services over Internet XML Document Server (Contents ; View ; Interaction) Ex. On-line Shopping Devices - order goods at Kiosk ..... touch panel - confirm the order with a mobile phone ..... voice - change the order at home ..... DTV remote terminal

  4. XML Document Server (Contents ; View ; Interaction) <xhtml ....... Form <salt: ...... <xhtml ........ <head> VoiceXML </head> <body> ........ How to do it? CSS CSS

  5. VoiceXML ........ <xhtml ....... Form <xhtml ....... Form contents- independent CSS CSS XISL: Extensible Interaction-Sheet Language remodels VoiceXML to meet MMI requirements <xisl> <dialog> <exchange> ........

  6. XISL: Device-Independent - 1/3 no modality-specific tag : input modality <input type=“speech” event=“recog” target=“grammar.gxml” match=“/grammar/goods” return=“goods_name”> <param name=“mode”>data</param> </input> <input type=“dtmf” event=“push” target=“grammar.gxml” match=“/grammar/goods_select”return=“goods_name”> <param name=“mode”>digit</param> </input> ...........

  7. Dialog Manager Front-end Module Keyboard Hello! <input ….. > type: speech type: speech Pointing event: recognize event:recognize recognize target: ***.xml grammar rule: introduction grammar match: /page ASR return: return: word1 word1: Hello word1:Hello type: pointing Hello : <input ….. > XISL: Device-Independent - 2/3

  8. no modality-specific tag : output modality type event mode window open, close, … speech play, stop, … TTS, rec_speech, … video play, stop, … audio play, stop, … agent move, speak, … XISL: Device-Independent - 3/3

  9. MMI Description Language: XISL - is content ( & view ) -independent. - has no modality-specific tags that enable XISL device-independent. - has MMI control tags and attributes. → • realizes seamless services over internet and reuse of XML documents. • meets modality-rich services and avoids patent issues.

  10.  adding a new modality Sequential Parallel Alternative XISL enables combinatorial usage of modalities.

  11. <?xml version=“1.0” encoding=“Shift-JIS”?> <!DOCTYPE xisl SYSTEM “xisl.dtd”> <xisl version=“1.0”> <head>.........</head> <body> <dialogue id = “WAP_phone”> <exchange> <operationcomb= “alt”> <input type=“dtmf” event=“push” target=“/d_gram.gxml” match=“/d_gram/goods_select” return=“number”> <param name=“mode”>digit</param> </input> <input type=“speech” event=“recognize” target=“/gram.gxml” match=“/gram/goods_select” return=“goods_name”> <param name=“mode”>data</param> </input> < /operation > XISL: example -1/2

  12. XISL: example -2/2 < action comb = “seq” > <output type=“speech” event=“play”/> <param name=“speaker”>nancy</param> <param name=“speech_text”> You selected No. One. < /output > < call dialogue_name=“2”/ > < /action > ： ： ：

  13. Input Integrator Input Modalities XISL XML XSL Interpreter Dialogue Manager Response Controller Output Modalities Document Server Implementation -1/4 System Architecture

  14. Implementation -2/4 Dialogue Control Front - end Start Dialog Document Server Input Integration Document Buffer Dialog Manager Interpreter GLRparser <input> <operation> Op. Control user operation <action> Action Execution transition <output> XML editing I/O profile

  15. Implementation -3/4 IN State ACTION TBL GOTO TBL buy_btn goods_sp timeout complete BUYGOODS EXCH1 ０ SHIFT-3 SHIFT-1 SHIFT-2 SHIFT-3 ０ １ ACCEPT ２ SHIFT-4 ３ SHIFT-5 ３ SHIFT-5 ４ REDUCE-1 ５ REDUCE-2 ５ REDUCE-2 Dialogue Control by Using GLR TBL

  16. Implementation -4/4 ① ③ ②

  17. XISL Tree View ･･･　ＸＩＳＬの構造をツリー形式で表示 Ｉｎｔｅｒａｃｔｉｏｎ　Ｗｉｎｄｏｗ ･･･　生成したＸＩＳＬを表示 Interaction Builder - binding MMI -1/4

  18. Interaction Builder - binding MMI -2/4

  19. <input type="touch" event="click" match="/OLS/goods_list/category/goods[@id='23']/object/picture[1]"/> Interaction Builder - binding MMI -3/4

  20. <output type="speech" event="agent-speech"> <![CDATA[ <param name="agent-name">Merlin</param> <param name="speech-text"> このコートは着心地抜群です </param> ]]> Interaction Builder - binding MMI -4/4

  21. Future Work - XHTML + XISL - Implementation of 3GPP applications - MMI Requirements: more complicated usage of MMI - Rapid-prototyping: GUI-based developer support system (IPA project) http://www.vox.tutkie.tut.ac.jp/XISL/XISL-E.html

More Related