Publications; Cafeteria menus; …

1. GesturalInteractionwithSpatiotemporalLinked Open DataPiLOD. Amsterdam, The Netherlands.jim.jones@uni-muenster.de

2. Gestural Interaction with Spatiotemporal Linked Open Data Our goal: To make any public information about the university available in machine-readable formats for easy access and reuse. • http://lodum.de • Publications; • Cafeteria menus; • …

3. Gestural Interaction with Spatiotemporal Linked Open Data LIFE is a two-year project funded by the German Research Foundation (DFG). • http://lodum.de/life/ • Meta Search: Institute for Urban History; • Semantic Annotation and Georeferencing for Historic Maps …

4. Gestural Interaction with Spatiotemporal Linked Open Data Agenda • Motivation • Application • Dataset Creation • Gesture-based Approach • Approach Evaluation • Conclusion • Future Work

5. GesturalInteractionwithSpatiotemporalLinked Open Data

6. GesturalInteractionwithSpatiotemporalLinked Open Data

7. Gestural Interaction with Spatiotemporal Linked Open Data Deforestation decreasing... 2004: 27.423 km² 2012: 4.571 km² (Awesome!) Known Issues • Data produced queued for analysis (Huge amounts) • Hard to visualize • Hard to correlate the produced data with external variables.

8. GesturalInteractionwithSpatiotemporalLinked Open Data Motivation • How to efficiently correlate the deforestation phenomena with external variables? • How to effectively communicate it to the population?

9. GesturalInteractionwithSpatiotemporalLinked Open Data Triangle of Sustainability • WissenschaftInteraktiv 2012 (Interactive Science) • Awarded with €10k for developing the project • 4 weeks for development! Linked Open Data!

10. Gestural Interaction with Spatiotemporal Linked Open Data Why Linked Data?(In 1 minute)

11. Gestural Interaction with Spatiotemporal Linked Open Data The Web • Awesome Discoverability! • But just for humans :(

12. Gestural Interaction with Spatiotemporal Linked Open Data Semantics ? The forbidden fruit Xxx xxxx x xxxx xxx xxxx Xxx xxxxxxx xx x xxxxxxxxx. Cheers, -God • What is the article about? • Who is the author? • What is inside the picture? • Where, when and by whom was the picture taken? • ...

13. Gestural Interaction with Spatiotemporal Linked Open Data Direct benefits of Linked Open Data • Attaches meaning to data • Allows efficient thematic searches (e.g. person, company, city, book, etc.) • Links different kinds of datasets making the WORLD a single big repository! • Private data and public data can be mixed, enabling companies and individuals to make better decisions and generate innovations. My Repository

14. Gestural Interaction with Spatiotemporal Linked Open Data Where to get the data?

15. Gestural Interaction with Spatiotemporal Linked Open Data Creating Dataset... Lei Nº 12.527, November 18th, 2011 “todos têm direito a receber dos órgãos públicos informações de seu interesse particular, ou de interesse coletivo ou geral, que serão prestadas no prazo da lei, sob pena de responsabilidade, ressalvadas aquelas cujo sigilo seja imprescindível à segurança da sociedade e do Estado”. http://www.planalto.gov.br/ccivil_03/_Ato2011-2014/2011/Lei/L12527.htm

16. Gestural Interaction with Spatiotemporal Linked Open Data Creating Dataset... Linked Brazilian Rainforest Dataset Deforestation • Downloads data from IBGE Servers • Creates Triples • Soybeans Crops • Cattle • GDP • Population • Brazilian Municipalities' Area

17. Gestural Interaction with Spatiotemporal Linked Open Data Dataset Spatiotemporal Dataset • Aggregated in grid cells of 25km x 25km • Time-series 2004 - 2009 Vocabularies • Time and Space Core Vocabulary (TISC) • http://observedchange.com/tisc/ns-20110511/ • Open Linked Amazon Vocabulary (OLA) • http://observedchange.com/amazon/ns/

18. GesturalInteractionwithSpatiotemporalLinked Open Data Motivation (Recap...) • How to efficiently correlate the deforestation phenomena with external variables? • How to effectively communicate it to the population? Gestural Interaction with Virtual Globes!

19. Gestural Interaction with Spatiotemporal Linked Open Data Enviroment Society Economy Correlated with Deforestation Data!

20. Gestural Interaction with Spatiotemporal Linked Open Data

21. Gestural Interaction with Spatiotemporal Linked Open Data Gestures time travel zoom in / out pan

22. Gestural Interaction with Spatiotemporal Linked Open Data Video ( +1 minute) http://www.youtube.com/watch?v=Jjzj84R1Tgc

23. Gestural Interaction with Spatiotemporal Linked Open Data Evaluating the Approach

24. Gestural Interaction with Spatiotemporal Linked Open Data Evaluation Procedure and Material • 5- 8 Minutes usage • Questionnaire with 28 questions in two groups: • 1 group: demographic information • e.g. gender, age, primary hand, familiarity with gesture control interfaces • 2 group: Task Load (NASA TLX – Task Load Index). Rating how well gestures and map actions fit together, from 0 to 20. • e.g. In which scale you define the mental or physical workload for the gestures? • No reward!

25. Gestural Interaction with Spatiotemporal Linked Open Data Test Group • Participants: 43 • 28 male • 15 female • Youngest : 10 • Oldest: 59 • Left handed: 7 • Right handed: 36 • Familiarity with gesture-based interfaces: • Familiar: 19 • Unfamiliar: 24

26. Gestural Interaction with Spatiotemporal Linked Open Data Results

27. Gestural Interaction with Spatiotemporal Linked Open Data Observations Most participants reported the gestures as mentally challenging in the first minutes Older people found the system very accessible, particularly when compared with their first time using a mouse. User recognition gets considerably affected when bystanders are ‘seen’ by the Kinect sensor.

28. Gestural Interaction with Spatiotemporal Linked Open Data Software Virtual Globe (UI) LOD Processing Gestures (Kinect) https://github.com/giatschool/triangle-of-sustainability

29. Gestural Interaction with Spatiotemporal Linked Open Data Hardware

30. Gestural Interaction with Spatiotemporal Linked Open Data Try it yourself! • NASA World Wind SDK Tutorial • Getting started with the Java API and LOD application examples. • http://ifgi.uni-muenster.de/worldwind-tutorial/ • Linked Brazilian Amazon Rainforest Data • Getting familiar to the LBARD dataset. • http://linkedscience.org/tutorials/exploring-the-linked-brazilian-amazon-rainforest-data/

31. Gestural Interaction with Spatiotemporal Linked Open Data Triangle on Tour! • SBPC Science Fair • Recife (August, 2013) • KIT-Alumini Club Seminar • Recife (September,2013) • GeoCamp • Campos do Jordao (November, 2013) • Ecogerma • Belém (November, 2013)

32. Gestural Interaction with Spatiotemporal Linked Open Data Conclusion The triangle provides an attractive and easy to use solution for displaying spatiotemporal LOD. It has a high acceptance in class-rooms (Already presented in many German schools) Participants were able to learn how to use 3 gestures without excessive workload. Linked Data offers a good bases for efficiently connecting deforestation data with external variables.

33. Gestural Interaction with Spatiotemporal Linked Open Data Future Work • Improve registration gestures • Inefficient when more than one person is in front of the sensor • Try different Kinect frameworks. • Enable registration by children (short people) • Minimum arm length problem.

34. Gestural Interaction with Spatiotemporal Linked Open Data

35. Gestural Interaction with Spatiotemporal Linked Open Data Muito obrigado. DankeSchön. Kiitos. Dziękujębardzo. Thank you!

36. Gestural Interaction with Spatiotemporal Linked Open Data Comments? Questions?