310 likes | 507 Views
In Dialogue with the Web. Torbjörn Lager, Dept. of Philosophy, Linguistics and Theory of Science University of Gothenburg. The web?. The web of documents The web of people The web of data The web of things. Interaction with the Good Ol' Web. The web browser – a window to the web
E N D
In Dialogue with the Web Torbjörn Lager, Dept. of Philosophy, Linguistics and Theory of Science University of Gothenburg
The web? • The web of documents • The web of people • The web of data • The web of things
Interaction with the Good Ol' Web • The web browser –a window to the web • Browsing (clicking links) • Searching (filling in forms, clicking buttons) • Interacting with a web application (all of the above plus dragging, dropping, selecting, etc.) • A direct manipulation style of interaction
Dialogue (Conversation) • A form of interaction, • between at least two agents, • often, but not always, for the purpose of exchanging information. • Has the form of a (fairly rapid) exchange of (fairly short) written or spoken utterances in natural language (often supplemented by gestures)
Digital Assistants http://www.ikea.com/se/
VoiceXML – a part of the Web HTML HTML browser VoiceXML Web servers VoiceXML browser(ASR, TTS, interpreter)
VoiceXML example <vxml version="2.1" application="franks.xml"> <form> <block> <prompt> Thanks for calling Frank's pizza palace. </prompt> </block> <field name="phone" type="digits"> <prompt> May I have your phone number please? </prompt> </field> <field name="correct" type="boolean"> <prompt> I heard <say-as interpret-as="telephone"><value expr="phone"/></say-as>. Is this correct? </prompt> </field> <filled> <if cond="correct"> <assign name="application.phone" expr="phone"/> <submit next="db-lookup-phone.cgi" namelist="phone"/> <else/> <clear namelist="phone correct"/> </if> </filled> </form> </vxml>
SRGS example <grammar tag-format="semantics/1.0" root="INIT"> <rule id="INIT" scope="public"> <one-of> <item> I would like a <ruleref uri="#size"/> <ruleref uri="#type"/> pizza with <ruleref uri="#topping"/> <tag>out.size = rules.size; out.type = rules.type; out.topping = rules.topping;</tag> </item> <item> <ruleref uri="#size"/> <tag>out.size = rules.size ;</tag> </item> ... </one-of> </rule> <rule id="size"> <one-of> <item> small </item> <item> medium </item> <item> large </item> <item> big <tag>out = 'large';</tag></item> </one-of> </rule> <rule id="type"> <one-of> <item> hand tossed </item> <item> cheese crusted </item> </one-of> </rule> </grammar>
More likely (in my view) • A web of agents (human and artificial agents) • Why? • The web will never become a consistent body of knowledge • The "beliefs" of artificial agents will vary as much as the beliefs of human agents • So we will need to be in dialogue with more than one of them, and sometimes with more than one at a time • Multi-party dialogue • The web of things will be involved as well. But things are things, not agents...
How? The big picture...
Key Fields and Notions • Knowledge representation • Interaction management • Natural language processing • Open standards • Formal foundations • Modelling techniques and methodologies
The Web of Data IBM.com Web Site Joe Person Lives in IBM Company Palo Alto City Publisher of Fan of Subscriber to Lives in Employee of Sue Person Jane Person Dave.com RSS Feed Fan of Coldplay Band Friend of Member of Depiction of Design Team Group Married to Source of Member of 123.JPG Photo Dave.com Weblog Bob Person Depiction of Member of Member of Dave Person Stanford Alumnae Group Author of Member of
Interaction Management • Interaction is a key notion here • The interaction between human and system (agent) • The interaction between different loosely coupled components of a single system (agent) • The interaction between one system (agent) and another • The interaction between human users of the web, mediated by a system • Handle these forms of interaction in a uniform way? • Interaction managers specified in Statecharts and SCXML
Open standards • For representing information/knowledge: • RDF, RDFS, OWL, SWRL • For specifying interaction: • SCXML
Flashlight Statechart in SCXML <scxml initial=“off"> <state id=“off"> <transition event=“push" target=“on"/> </state> <state id=“on"> <transition event=“push" target=“off"/> </state> </scxml>
Foundations • RDF, RDFS, OWL and SWRL are based on logic • SCXML is based on the theory of state machines • states, transitions between states, triggered by events
Natural Language Processing Page intentionally left blank...
Modelling • Knowledge engineers • Interaction designers • (Computational) linguists
Spyderbrain Technologies http://spyderbrain.ling.gu.se