Presented by Abu Saleh Md. Mahfujur Rahman Supervisor Professor Dr. Abdulmotaleb El Saddik

1. Suitability of Searching and Representing Multimedia Learning Resources in 3D Virtual Gaming Environment Presented byAbu Saleh Md. Mahfujur Rahman Supervisor Professor Dr. Abdulmotaleb El Saddik Multimedia Communications Research Laboratory (MCRLab)University of Ottawa http://www.mcrlab.uottawa.ca

2. Outline • Motivation and Related Study • Proposed System • 3D Gaming Environment • Implementation • Result Analysis • Conclusion and Future Work

3. Motivation and Related Study • Information visualization is the use of computer supported, interactive, visual representations of abstract data to amplify cognition. • The traditional systems: • Poor way of Information visualization • Less intuitive navigation space • Lack of entertainment in learning • Problem statement: Suitability of visualizing learning resources from a set of available search repositories using metaphors in a structured [13] way, which improves the perception of the learners as well as offers entertainment with education.

4. Motivation and Related Study (cont.) • Our approach: • 3D virtual environment: attractive large display space as well as natural and cognitive aspects. • Using gaming metaphor: provide entertainment in navigating the environment • Organized representation of data: allows the users to directly interact with the data, get insight, and come up with new hypotheses. a) Car metaphor b) Spaceship metaphor c) Library metaphor

5. Data Model LO in Repositories LO in P2P LO in Web Graphical Model Data Representation Model VE Model 3D GUI Control Proposed System Figure 2. Schematic diagram of the proposed system

6. Data Model: Learning Objects Communities using different elements and vocabularies create difficulties to share and reuse resources Learning Object: "any entity, digital or non-digital, that may be used for learning, education or training” (IEEE LTSC) LOM is defined by IEEE LTSC for identifying, searching, and retrieving LOs Proposed System (cont.)

7. Proposed System (cont.) • Data Model: Access Paradigm • LOR contains LOs or their references along with LOM • All elements are optional • Can be difficult to know which elements to use Figure 3. Learning Object access paradigm

8. Graphical Model Data Representation Model Proposed System (cont.) TABLE I Model template representations of Learning Object Figure 4. 3D Traffic Sign Template for representation of LOs (e.g. traffic sign for html)

9. Proposed System (cont.) • Graphical Model • VE Model • Avatar • Terrain • Reference Models

10. Searching Personalization Clustering and 3D Mapping Navigation Interaction Randomization 3D Gaming Environment Figure 5. Layered search model

11. 3D Gaming Environment (cont.) • Clustering and 3D Mapping • Display relevant and grouped search results in the 3D road layout so that navigation and information selection become easy. • Based on the searched keywords the prototype applies heuristic methods to create relevance metrics to construct groups from the search results.

12. Clustering and 3D Mapping AlgorithmSEARCH_RESULT_CLUSTERING Progressively look-up the search result to find relevant keywords based on the initial search keyword Add new keywords to the keyword set and apply equation 2 to calculate distances between each pair to form keyword array matrix Quick-Sort the matrix values based on the distances in ascending order Apply Minimum Spanning Tree (MST) algorithm over the matrix End SEARCH_RESULT_CLUSTERING 3D Gaming Environment (cont.) Figure 6. Semantic keyword metrics MST tree and corresponding road architecture

13. 3D Gaming Environment (cont.) • Personalization • Enables users to personalize their searching, navigational and learning experience within the 3D world. • Maintains individual user profile that includes user’s demographic information, age limit, area of expertise, topics of interest, search history, among others. • Individual profile info are taken into consideration while searching LOs and delivering the targeted 3D virtual environment to the user. • Allows to select the 3D shape of the learning objects and also the virtual avatar • A user is able to save any visited object and put it in his/her favorite list.

14. Navigation Collision detection is used to help the user stay within the search layout Appropriate ideograms, landmark, and reference models are provided. A preview of the 3D landscape is used as a navigational map in order to show the navigating user his/her point of presence in the 3D environment. Furthermore, a direction indicator that always points to a reference position prevents the user from getting lost in the 3D world. 3D Gaming Environment (cont.) Figure 7. Navigational layout of the 3D metaphor

15. Interaction User interacts with the displayed search results for Viewing the associated metadata description Playing/previewing the LO Saving the search history in the local repository for later review The user interaction can be performed through Keyboard Mouse Joystick Microphone or any combination of these devices. 3D Gaming Environment (cont.) Figure 8. High level user interaction model

16. Software Architecture Implementation Figure 9. Software architecture of EYE&WHY prototype

17. Implementation • Sample Interface: dynamic traffic layout Figure 10. A typical 3D search interface

18. Implementation (cont) • Sample interface: static traffic layout Figure 11. A typical 3D search interface

19. Implementation (cont) • Searching/sharing learning objects Figure 11. A typical 3D search interface

20. Implementation (cont) • Searching/sharing learning objects Figure 11. A typical 3D search interface

21. Implementation (cont) • Searching/sharing learning objects Figure 11. A typical 3D search interface

22. QuantitativeMeasurements Test Result Analysis Figure 11. Mapped search results vs. frame rate/sec Figure 12. Mapped search results vs. total triangle count

23. QuantitativeMeasurements Test Result Analysis (cont) Figure 13. Search time comparisons of different search services Figure 14. Search result grouping and mapping time in 3D VE

24. Qualitative Measurements Test Result Analysis (cont) Figure 15. User response percentage on the evaluation of the 3D metaphor TABLE II User satisfaction on the overall evaluation

25. Qualitative Measurements Test Result Analysis (cont) Figure 16. User satisfaction based on 3D application/gaming experience Figure 17. Comparison between responses of users from two different age groups.

26. Conclusion and future-work • We presented a new way of visualizing search results in a 3D virtual gaming environment and measured the suitability of such approach. • Gaming by default has its own attractions to the user especially to the younger users as it provides intuitiveness in the search and exploration operations that are performed while navigating the 3D world. • We evaluated our prototype system in terms of quantitative and qualitative measurements aspects. • The spatial landscape of a 3D environment, in order to represent more information at a time, is proved to be useful.

27. Conclusion and future-work (cont.) • Use of enhanced user control, e.g. HMD, Data Gloves, Haptics, etc. • Finding new metaphors to enhance user experience • Applying rules and heuristics to add scoring system to achieve the game like experience • Collaboration between users in a single searching environment

28. References E. Duval and w. Hodgins, "a lom research agenda," proc. 12th int’l conf. World wide web (www2003), may 2003. IEEE learning object metadata, final draft standard, jul. 15, 2002 (ieee1484.12.1); http://ltsc.Ieee.Org/wg12/files/lom_1484_12_1_v1_final_draft.Pdf, accessed sept. 05, 2005. Edusourcecanada, canadian network of learning object repositories; http://www.Edusource.Ca/english/objects_eng.Html, accessed oct. 5, 2005. Ariadne - http://www.Ariadne-eu.Org, accessed jan 17, 2005. W. Cellary, w. Wiza, and k. Walczak, "visualizing web search results in 3d," computer, vol. 37, no. 5, pp. 87-89, may 2004. W. Wiza, k. Walczak, and w. Cellary, "periscope - a system for adaptive 3d visualization of search results," proc. 9th int’l conf. 3d web technology (web3d'04), pp. 29-40, apr. 2004. J. Klerkx, e. Duval, and m. Meire, "using information visualization for accessing learning object repositories," proc. 8th int'l conf. Information visualization (iv'04), pp. 465-470, july 2004. Lightweight java game library, http://lwjgl.Org/, accessed sept. 20, 2005. P. Chiu et al., “Mediametro: browsing multimedia document collections with a 3d city metaphor,” proc. 13th annual acm international conference on multimedia, hilton, singapore, pp. 213–214, nov. 2005. C. Russo dos santos, p. Gros. "Multiple views in 3d metaphoric information visualization," 6th international conference on information visualization (iv'02), pp. 468-473, 2002. Wordnet - a lexical database for the english language, http://wordnet.Princeton.Edu/, accessed jan. 27, 2006. Jxta – open protocols for peer to peer network, http://www.Jxta.Org/, accessed jan 20, 2006. Mukherjea, S., Foley, J., and Hudson, S., (1995):“Visualizing Complex Hypermedia Networks through Multiple Hierarchical Views”. Proceedings of ACM SIGCHI '95

29. Ευχαριστώ DMnvwd Dankie go raibh maith agaibh WAD MAHAD SAN TAHAY GADDA GUEY متشکرم Urakoze Asante