Issues on Interaction with Web The coming of heterogeneous devices and interaction manner access by : PC, Mobile phone, PDA, AutoPC, DTV, interaction

Size: px

Start display at page:

Download "Issues on Interaction with Web The coming of heterogeneous devices and interaction manner access by : PC, Mobile phone, PDA, AutoPC, DTV, interaction "

えみたておか
7 years ago
Views:

1 Web MMI MMI MMI

2 Issues on Interaction with Web The coming of heterogeneous devices and interaction manner access by : PC, Mobile phone, PDA, AutoPC, DTV, interaction with: modality-rich terminals, mixed initiative,...

3 Our Purpose: Seamless Services over Internet XML Document Server (Contents ; View ; Interaction) Ex. On-line Shopping Devices - order goods at Kiosk... touch panel - confirm the order with a mobile phone... voice - change the order at home... DTV remote terminal

4 How to do it? XML Document Server (Contents ; View ; Interaction) <xhtml... Form <salt:... <xhtml... <head> VoiceXML </head> <body>... CSS CSS

5 XISL: Extensible Interaction-Sheet Language remodels VoiceXML to meet MMI requirements <xisl> VoiceXML... <xhtml... <xhtml... <dialog> <exchange>... Form Form contentsindependent CSS CSS

6 XISL: Device-Independent - 1/3 no modality-specific tag : input modality <input type= speech event= recog target= grammar.gxml match= /grammar/goods return= goods_name > <param name= mode >data</param> </input> <input type= dtmf event= push target= grammar.gxml match= /grammar/goods_select return= goods_name > <param name= mode >digit</param> </input>...

gxml match= /grammar/goods return= goods_name > <param name= mode >data</param> </input>

7 XISL: Device-Independent - 2/3 Keyboard Front-end Module Dialog Manager Hello! Pointing Hello ASR grammar word1: Hello type: speech event:recognize recognize grammar rule: introduction return: word1 type: pointing : <input.. > type: speech event: recognize target: ***.xml match: /page return: word1:hello <input.. >

grammar rule: introduction return: word1 type: pointing : <input.

8 XISL: Device-Independent - 3/3 no modality-specific tag : output modality type event mode window open, close, speech play, stop, TTS, rec_speech, video play, stop, audio play, stop, agent move, speak,

9 MMI Description Language: XISL - is content ( & view ) -independent. - has no modality-specific tags that enable XISL device-independent. - has MMI control tags and attributes. realizes seamless services over internet and reuse of XML documents. meets modality-rich services and avoids patent issues.

10 XISL enables combinatorial usage of modalities. adding a new modality Sequential Alternative Parallel

11 <?xml version= 1.0 encoding= Shift-JIS?> <!DOCTYPE xisl SYSTEM xisl.dtd > <xisl version= 1.0 > <head>...</head> XISL: example -1/2 <body> <dialogue id = WAP_phone > <exchange> <operation comb = alt > <input type= dtmf event= push target= /d_gram.gxml match= /d_gram/goods_select return= number > <param name= mode >digit</param> </input> <input type= speech event= recognize target= /gram.gxml match= /gram/goods_select return= goods_name > <param name= mode >data</param> </input> < /operation >

12 XISL: example -2/2 < action comb = seq > <output type= speech event= play /> <param name= speaker >nancy</param> <param name= speech_text > You selected No. One. < /output > < call dialogue_name= 2 / > < /action >

13 MMI

14 Web XISL XML XSL

15 XISL XML

16 XISL <xisl application= app-root.xisl > <dialog id= 1 > <exchange> <operation comb= par > <input type= speech target= sample.grm.. /> <input type= touch event= click match= /button1 /> </operation> XML <action comb= seq > <output type= agent event= speech > </output> <goto next= 2 /> </action>

17 XISL <xisl application= app-root.xisl > <dialog id= 1 > <exchange> <operation comb= par > <input type= speech target= sample.grm.. /> <input type= touch event= click match= /button1 /> </operation> <input> <action comb= seq > <output type= agent event= speech > </output> <goto next= 2 /> <output> </action>

18 XISL <submit> - CGI <prompt> - ECMAScript

19 XISL XISL <input><output>

20 <input> <output> GLR <operation> <action> XISL XML

21 <dialog> <input> GLR <dialog> <input> <input> <input> <operation>

22 Implementation -3/4 Dialogue Control by Using GLR TBL IN State buy_btn SHIFT-3 ACTION TBL goods_sp timeout SHIFT-4 SHIFT-5 complete ACCEPT GOTO TBL EXCH1 SHIFT-1 SHIFT-2 BUYGOODS REDUCE- REDUCE-2 2 REDUCE-1

23 <input> <output>

24 PC

25 PC MMI XML Web HTML TTS) TTS

26 OLS

27 Implementation -4/4

28 Interaction Builder

31 - 2/6

32 - 3/6

33 - 4/6

34 Future Work - XHTML + XISL ; DOM2, XForms, XMLevent, SMIL.. - Implementation of 3GPP applications - MMI Requirements: more complicated usage of MMI - Rapid-prototyping: GUI-based developer support system (IPA project)

スライド 1

スライド 1 2010.2.18 CSS Nite in Ginza Vol.44 JIS X 8341-3 60 1 2004 vs 2010 2010 2 18 2010.2.18 CSS Nite in Ginza Vol.44 3 2004 10 Web Web JIS X 8341-3 W3C / WCAG 2010.2.18 CSS Nite in Ginza Vol.44 2010.2.18 CSS