1 / 26

towards a ubiquitous semantics of interaction

This paper explores the formalism in Human-Computer Interaction (HCI), specifically focusing on the challenges and potential solutions in adopting formal methods. It discusses the factors that contribute to the uptake of formalism in HCI, such as expertise, utility, tools, cost, and fear. The paper also examines the importance of notations in HCI and proposes strategies for moving towards a ubiquitous semantics of interaction. The advantages of shared semantics, Galois connections, and mapping between different notations are highlighted, along with the significance of addressing real-time issues in HCI. The paper concludes by discussing the hierarchy of time in task analysis and the challenges in achieving clear and shared semantics in HCI.

goodfellow
Download Presentation

towards a ubiquitous semantics of interaction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. towards a ubiquitous semantics of interaction Alan Dix Lancaster University

  2. formalism in HCI adolescence or … rigormortis

  3. formalism in HCI • blocks to uptake? • expertise • utility • tools • cost • fear • use only where value exceeds cost • safety critical, ?generic widgets?

  4. ubiquity • lots of simple devices • but complex context: • lots of users • mobile • context dependent behaviour • good for FM

  5. simple devices complex context ubiquity good for formal methods!

  6. discrete most common good for GUI familiar notations continuous very few VR, ubicomp simpler semantics models what do they mean?

  7. notationfever! pattern

  8. notations • lots of them • why? • cult of notation in computer science • differing paradigms and problems • tractability • familiarity

  9. myriad notations • problems • communication • education • tools • meaning and satisfaction ?? moving to ubiquity ??

  10. routes myriadnotations interoperability UML-ishness single notation one size fits alltranslation shared semanitics

  11. transformation model 1 model 2 (notation A) (notation B) Galois connection

  12. model 1 model 2 model 1 model 2 common semantics? complete meta-semantics

  13. model 1 model 2 common semantics? shared sub-semantics

  14. external phenomena trace / scenario

  15. advantages obvious physical/real common relates to real time problems not obvious e.g. CCS/CSP internal structure binding to real granularity/instants real time issues

  16. Z * x Y instances x a b c a x happenings b a x a Y b c meta-model model time

  17. instances a – b – a – b – a – c – a – b … happenings < < < < < < < event stream model P  a b P | a c P time

  18. somestate otherstate turntaking & states action response s0 – a1 – r1 – s1 – a2 – r2 – s2 – … one happening or two?

  19. Z * x Y interstices a b c ? NO mapping model 1 P  a b P | a c P < < < < < < < < < < < < < model 2

  20. status and events A S1 S2 A S1 – A – S2 – A – S1 – A – S2 ….

  21. 0. DSV-IS talk 1. prepare 2. talk 3. discussion 2.2 sld 1 2.2 sld 1 2.3 conc 3.1 Q 3.2 A 3.1 Q 3.2 A 2.1 intro time hierarchies – task analysis

  22. application level change selection format dialogue level underline is ‘word’ subscript size is 10 finished! click radio btn mouse activity on menu font size menu click OK lexical level layers – UI events None Word Single Double Dotted

  23. continuous • status–event analysis • CS hybrid system literature • TACIT – hybrid Petri Nets & continuous interactors • Wuther???? – systems theory

  24. common features • actions • at events, discrete changes in state • interstitial behaviour • between events, continuous change

  25. other continuous issues • granularity issues – do it today • two timing – infinitely fast times • temporal gestalt – words, gestures

  26. summary • harder than it looks! … but easier than pairwise matching • consequences: less sloppy semantics clear semantics  shared toolsfoundation …

More Related