1 / 17

Imaginarium Merging science and practice

Imaginarium Merging science and practice. David Kirsh , UCSD Cognitive Science, Assoc. Director ACCHI Erik Viirre M.D. Ph.D., UCSD School of Medicine Sheldon Brown , UCSD Visual Arts, Director of ACCHI Plus collaborators…. Objectives.

nen
Download Presentation

Imaginarium Merging science and practice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ImaginariumMerging science and practice David Kirsh, UCSD Cognitive Science, Assoc. Director ACCHI Erik Viirre M.D. Ph.D., UCSD School of Medicine Sheldon Brown, UCSD Visual Arts, Director of ACCHI Plus collaborators…

  2. Objectives • Observation: Study the nature of distributed creativity in the natural setting of: • Brain storming • Design • Creative Expression • Theory: Build a more comprehensive theory of activity and sensory involvement during brainstorming • Design: Explore impact of changes in environment design on imagination, creativity and problem solving

  3. Imaginarium Technology • Binocular eye tracking among groups • Video cameras coordinated with eye tracking • Kinects for gesture detection • Portable ERP caps • Precise sound localization • Whiteboard and other surface capture • Automated Annotation of design session • Remote interaction with other sites

  4. Analytic Techniques • Ethnographic coding, activity analysis, • Datamining for patterns among different capture records • Machine learning using VATIC and crowd sourcing to classify events defined via activity analysis • Analyses using theories of distributed, situated and embodied cognition

  5. Collaborators Relevant Research Basis • Kirsh: NSF on Distributed Creative Cognition • In choreography • being expanded to music • Makeig, Saygin: ERP (Event Related Potentials) during activity • Trivedi: Video and Auditory awareness systems. • Viirre: Eye Tracking for wayfinding, medical diagnosis and therapy • Brown: User analytics of virtual worlds

  6. Observation Set-Up for Distributed Creative Cognition in Choreography - Kirsh • Mandeville Auditorium • Cal-IT2

  7. Oculomotor Measuring Equipment

  8. Video Engineering • Wide Angle Camera to identify head • High resolution camera slaved to get face/eye activity • Analysis of video image (visible/IR)

  9. Body and Gaze Tracking

  10. Tool for Collaboration • Centered around whiteboard, display table, workbench • Annotation • Command interaction (Kinect)

  11. Medical Evaluation • Monitoring of Movement control • Fall Risk • Movement control • ADL • Evaluation of Disease progression • Vestibular • Parkinsons • Diagnosis? • Cerebrovascular vs. Neurodegenerative

  12. Research Questions • Are binocular indices sensitive indicators of neural disruption • What do “natural” eye movements look like? • Combined Eye-Head • Head Free • Scan paths

  13. Embedded Cognition Theory • Interaction with physical objects • Mental planning, practice • Learning theory of tasks

  14. Principals • Erik Viirre, Medicine • David Kirsch, Cog Sci • Mohan Trivedi, Engineering • Sheldon Brown, Visual Arts

  15. Funding Sources • Industry Partners • Medical Research • DOD/VA • NIH • NSF Computing, sensors, creativity, social sciences

More Related