310 likes | 456 Views
MeMoML. Master project MeMoML for the MeModules project. Seminar: tangible user interfaces University of Fribourg David Bächler. 23.12.2005. david.baechler@unifr.ch. Content. MeModules project Description Goals State of the art Markup languages for TUIs MeMoML project MeMoML
E N D
MeMoML Master project MeMoML for the MeModules project Seminar: tangible user interfaces University of Fribourg David Bächler 23.12.2005 david.baechler@unifr.ch
Content • MeModules project • Description • Goals • State of the art • Markup languages for TUIs • MeMoML project • MeMoML • MeMoEngine • MeMoML-GUI • Schema MeMoML: david.baechler@unifr.ch
MeModules project • MeModules • tangible links between the human memory and reachable information • Collaboration EIA (www.eif.ch) - UniFr • Co-financed by the Hasler foundation • 2 + 1 years from January 1st on MeMoML: david.baechler@unifr.ch
Lost in the “InfoSpace” effect: Information overload in our daily life MeMoML: david.baechler@unifr.ch
Lost in the “InfoSpace” effect: Information overload in our daily life MeMoML: david.baechler@unifr.ch
associative memory real association physical reminder MeModules project • Designing and implementing a system for creating and managing tangible shortcuts to multimedia information • Change the traditional way of communication with computers • GUI TUI MeMoML: david.baechler@unifr.ch
MeModules project • Two main goals • Easy interaction with devices in the everyday life • Information categorization in order to improve information access and retrieval • Secondary goal • Collaboration of academic university (UniFr) and university of applied sciences (EIA) MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • Markup languages for tangible user interfaces • Why MLs? • Heterogeneous environment • All devices must be formally described • Multitude of particular accesses to devices • Standardized access to devices MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • Not a lot of existing work in the field of meta- or markup-languages for tangible user interfaces • Very new area MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • TUIML • high-level description language for TUIs • Small part of the TUIMS project • TUIMS • Laying the Foundations for a Tangible User Interface Management System • http://www.eecs.tufts.edu/~oshaer/TUIMS.pdf • http://www.cs.tufts.edu/tech_reports/reports/2005-2/report.pdf(2004-2005 ongoing work) MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • UserML • User Modeling Markup Language (UserML) for Ubiquitous Computing • Based on XML • A User Model Editor transforms UserML into XForms with XSLT • http://www.dfki.de/~krueger/PDF/UM2003.pdf(published 2003) MeMoML: david.baechler@unifr.ch
UserML Example • partial user model which uses categories from the ontology ”UserOL” <UserModel> <UserData id="231"> <category>userproperty.timepressure</category> <range>low-medium-high</range> <value>high</value> <ontology>"http://www.u2m.org/UserOL/"</ontology> </UserData> <UserData id="224"> ... </UserData </UserModel> MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • MRIML • Mixed Reality Interface Markup Language • Interface markup language for defining cross-platform user interfaces • Contained in the VR and AR framework • A Framework for Realizing Multi-ModalVR and AR User Interfaces • Frauenhofer Institut • http://www.fit.fraunhofer.de/gebiete/mixed-reality/publications/broll05.pdf(published 2005) MeMoML: david.baechler@unifr.ch
MRIML Example • Description of a button <part class=”Button” id=”numericalValues”> <style> <property name=”type”>pushButton</property> <property name=”position”>0.0 0.0 0.0</property> <property name=”orientation”>0.0 0.0 0.0</property> <property name=”isVisible”>false</property> </style> <part class=”FocusListener” id=”numericalValuesFocusListener”> … </part> </part> MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • PML • Physical Markup Language • « for communicating a description of physical environments and the objects within them, their relationships to you, each other and the space » • Philips • http://www.research.philips.com/technologies/syst_softw/pml/downloads/pml.pdf • http://www.research.philips.com/technologies/syst_softw/pml/ MeMoML: david.baechler@unifr.ch
State of the art of TUI MLs • TouchMe • Diploma project of Andy Gonzalez at EIA (2005) • Communication with RFID tags • Causes actions at computer (e.g. Open browser, show photos, play music) • Started work towards categorization of objects and actions • But the main goal was to have a running application • MeMoML will continue the categrozation and formalization MeMoML: david.baechler@unifr.ch
MeMoML • MeModules Markup Language • Every tangible link described via a predefined scenario • physical objects • communication processes • targeted actions • flexible, device-independent and easy-to-use language for describing scenarios MeMoML: david.baechler@unifr.ch
MeMoML Objects • Source with Attributes (simple, complex) • Target with Attributes (simple, complex) • Communications • Cable, Wireless • Actions • Send, Read, Play MeMoML: david.baechler@unifr.ch
MeMoML • Example • <OBJECT A = Seashell, …..> • <COMMUNICATION = MonoTag reader> • <ACTION = Play> • <OBJECT B = CD> MeMoML: david.baechler@unifr.ch
MeMoEngine • identify objects • ensure communication processes • execute actions, described in the scenario (with MeMoML) MeMoML: david.baechler@unifr.ch
MeMoEngine • Physical level • PC with several devices attached • Configuration file for all devices • formal description of the device • location information (path) • communication capabilities CD player, beamer, video player, … MeMoML: david.baechler@unifr.ch
MeMoEngine • Example • <DEVICE = CDPlayer PATH= /Path/… COMMUNICATION= WiFi> • <DEVICE = Beamer PATH = /Path/… COMMUNICATION= wire> MeMoML: david.baechler@unifr.ch
+ + = slideshow holiday pictures music MeMoEngine • Functioning of the MeMoEngine • Configuration • Use of MeMoML • Create scenario MeMoML: david.baechler@unifr.ch
Seashell Pictures Business card send MeMoML-GUI • facilitate the interaction with the MeMoML language • The MeMoML code is created “behind the scene” + Result: the person receives the pictures of the slideshow MeMoML: david.baechler@unifr.ch
Schema MeMoML: david.baechler@unifr.ch
Schema MeMoML: david.baechler@unifr.ch
Further information • Omar Abou Khaled (Supervisor EIA) • omar.aboukhaled@hefr.ch • Elena Mugellini (Assistant EIA) • elena.mugellini@hefr.ch • Denis Lalanne (Unifr) • denis.lalanne@unifr.ch Questions? • Website: • MeModules homepage • (coming soon) MeMoML: david.baechler@unifr.ch