1 / 52

Intelligent Human-Computer Interfaces

Intelligent Human-Computer Interfaces. Reinhold Behringer Leeds Metropolitan University. About Myself. “Running Stream Professor of Creative Technology” since 2005. Before: Research scientist at Rockwell Scientific (RSC), Thousand Oaks, CA Dr.-Ing. from UniBw Munich, Germany Interest:

rianna
Download Presentation

Intelligent Human-Computer Interfaces

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Intelligent Human-Computer Interfaces Reinhold Behringer Leeds Metropolitan University

  2. About Myself • “Running Stream Professor of Creative Technology” since 2005. • Before: • Research scientist at Rockwell Scientific (RSC), Thousand Oaks, CA • Dr.-Ing. from UniBw Munich, Germany • Interest: • Intelligent systems Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  3. About my Employer • Leeds Metropolitan University • “Innovation North” (Faculty for Information and Technology) • Leading the Centre for Creative Technology • Work areas: • R&D of Human-Computer Interaction Technology Systems • Context: computer music, computer games, computer graphics Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  4. BarCamp • Session or presentation? • Interaction • Some “food for thought” • Ideas • Concepts Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  5. Intelligent HCI • Human-Computer Interface (HCI) • Increased intelligence of computing system: • More intuitive use by humans. • Non-expert users can use computers. • Current problems: • Still interface hurdles: keyboard/mouse is ok for “office” applications, but not suitable for “computer as team partner” • Especially for mobile applications: novel way of interacting is necessary. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  6. Creative Technology – Oxymoron? • What is Creative Technology? • Technology used in the creative domain. • Creative domain: • Graphics, multimedia, music, games, video/film. • What is an Oxymoron? • Definition by Wikipedia: • Figure of speech that combines two normally contradictory terms. • Greek: Oxy = sharp, moros = dull. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  7. Creative Technology – Oxymoron? • Premise in answering this question: • Technology itself is not creative. • But it can enable human creativity: • Providing new methods for creating art, games, music. • Can be supporting either conventional methods, or enabling completely new art forms. • Initial answer: yes, the term “Creative Technology” is an Oxymoron. • But: “Artificial Creativity” is a current research topic. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  8. Intelligence at Interface • Computer made more “intelligent”: • Automatic recognition • Automatic actions which “make sense”. • Goal: • Computer similar to human, in its interaction and responses. • Will allow a more intuitive interaction. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  9. My Projects in Computer Intelligence • Computer Vision • Automatic Cars • Augmented Reality • 3D Photo Browser in Google Earth • The Computer as Musician • Planned projects: • Video/graphics into music, music into graphics • Wearable computing: surveillance by the individual Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  10. Computer Vision • Automatic recognition of • Scene • Context • People • Objects • Applications: • Robotics • Security / surveillance Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  11. PROMETHEUS Project (1996) • Autonomous road vehicle drives in public road traffic among other among other traffic participants. • Computer Vision is employed as a tool for detecting road markings. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  12. Principle of Action • Rene Descartes (1677) “Tractatus de Homine” • Visual feed-back of recognition of lane markings keeps vehicle centred within the lane. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  13. Results • Driving from Munich to Denmark (and ret.): 1600 km, 95% automatically • Usual top speed: 130 km/h (80mph) • Top speed: 180 km/h (110 mph) • Collaboration with Mercedes: • technology used in truck, lade-departure warning system. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  14. DARPA Grand Challenge • Competition of driverless vehicles • 2004 and 2005: in California desert • 2007: in urban area. • Prize awarded: • 2005: $2M • 2006: total of $3.5M Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  15. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  16. The SciAutonics Vehicle • Robust Autonomous Sensor-Controlled All-Terrain Land-Vehicle = RASCAL. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  17. System Architecture Obstacle detection Sensors: Road / path tracking GPS, compass Behavior control – “central brain” Path planning – map Sensor fusion: RF E-stop, remote control Vehicle control system High level control: steering brake throttle D/N/R Odometer, INS Low level control & servos: Vehicle Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  18. Results Computer Vision Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  19. Video of RASCAL in May 2005 Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  20. 2007 Winner: “Boss” from CMU Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  21. 6 Cars – No Major Crash Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  22. Robots and Human-Driven Cars Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  23. DARPA Grand Challenge • Pictures from “Motor Trend” • http://www.motortrend.com/features/auto_news/2007/112_0711_darpa_urban_challenge_reflections • Winner: CMU, got $2 M • 2nd: Stanford, got $1M • 3rd: VT, got $500k Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  24. Augmented Reality • Output paradigm of placing information (perception artefacts) into the user’s perception of the real world as if they are part of the real world. • Intuitive, “seamless” interaction with information in spatial real-world context. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  25. Augmented Reality Applications • Industrial maintenance, • Training, • Navigation, • Hazard warning, • Wherever spatial context information is provided. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  26. Head-Worn Displays SONY Glasstron (1998) Ivan Sutherland (1960s) Microvision HWD (2006) Etched glasses (MicroOptical) (1999) Lumus (2006) Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  27. Tracking • Obtain user’s position and orientation relative to object of interest. • Methods: • Computer Vision: • Specific markers can be recognized by system. • Magnetic sensing. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  28. Recognition of Markers Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  29. AR for System Diagnostics • Industrial Pump Diagnostics: • Live sensor data were visualised on head-worn display. • Tracking was achieved with computer vision methods for recognising and tracking of markers. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  30. Head-Worn Display Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  31. Video Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  32. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  33. Future Possibilities • Augmented Reality in truly mobile devices: • Mobile phones with cameras. • Games with Augmented Reality. • Computer Vision as tool for automatic capture of context. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  34. Geographic Visualisation of Photos • Fusion of individual photographs with location = “Geo-tagging” • Services: Flickr, Panoramio • Current state: overlay on map. • Future: integrate photo with 3D model: • Either by texture mapping onto 3D model • Or by overlay into the user’s view. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  35. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  36. Location of Picture in Map With Google Maps display Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  37. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  38. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  39. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  40. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  41. The Computer as Musician • Can computer replace a musician in a band / orchestra? • Requires: • Following the music score • Being able to synchronize to human instrumentalists. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  42. Beat Detection • Capture music with microphone. • Process signal to detect beat. • Complex algorithms required: • Problem is solved only for very simple cases. • Leeds Met Centenary PhD student Michael Ward is working on this project. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  43. Human musicians in orchestra Conducting Music • Tempo flow is “felt” by a musician: • If playing, tempo is done intuitively. • For orchestra, conductor provides tempo reference to players. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  44. Human musicians in orchestra Synthesiser Proposed Solution Visual tracking of baton / hand t Create tempo map Bridge the latencies by prediction and extrapolation, based on music score. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology Digital score in sequencer.

  45. System Concept 2D point sequence 50 or 60 fps Visual Tracking Interpolation of motion timeline Spline curve of motion AcousticTracking Analysis of motion timeline Tempo and beat position Possible: expression Notes from MIDI file Play synthesizer Extrapolation to current time Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  46. Possible Applications • Automated events for performance, e.g. lights, stage events, sounds, synchronous to music and determined by expression of conductor. • Additional accompanying electronic instrument, playing synchronously with orchestra. • Shaping time-flow of digital synthesizer rendition of music. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  47. Future Projects • Correlation of graphics/video and music/sound: • How do they relate to each other? • How can music be represented graphically? • How can visuals be translated into sound/music? • System for automatic logging and recording. • Automatic diary of activities, based on motion tracking, audio (microphone) and video (camera) input. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  48. Conclusion • Interesting projects with increased machine intelligence: • Automatic cars • Computer as musician • Novel interfaces: • Computer Vision as “input” • Augmented Reality as “output” Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  49. Issues Raised • Ethics: • Technology impact • Funding: • Would a “Challenge-based” funding work in the UK? • Intellectual: • Can machines be “intelligent” or “creative”? Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

  50. Ethics • Privacy? • Ubiquitous recording. • Fighting back ubiquitous surveillance by individual recording: empowering the individual. • Steve Mann (2007) "Smart Clothing: Wearable Multimedia Computing and 'personal imaging' to Restore the Technological Balance Between People and Their Environments" ", Proceedings of the Fourth ACM International Conference on Multimedia, February 1997 • Develop new technology, which has negative consequences for humans? • “Hiroshima of Information Technology” • Much of interesting technology is funded by military. Leeds Metropolitan University Innovation North – Faculty Of Information And Technology

More Related