190 likes | 205 Views
This project explores the use of automatic data collection, intelligent post-processing, and natural interaction to bridge the gap between virtual classrooms and managing traffic on the streets. It focuses on capturing and synchronizing PowerPoint slides, whiteboard images, and instructor videos, and applies similar principles to analyzing traffic patterns. The aim is to provide a seamless and efficient system for understanding and managing traffic flow.
E N D
From Virtual Classroom to the Virtual Streets Emmanuel Velasco City College of New York Capstone 1 Fall 2004
CCNY Virtual Classroom Objectives • Automatic Data Collection • Intelligent Post-Processing • Natural Interaction between students, teachers and computers.
Automatic Data Collection PowerPoint Slide Capture Mimio Virtual Ink Omnidirectional Camera
Automatic Data Collection PowerPoint Slide Capture • The start date and time is added when recording, to synchronize the recorded PowerPoint slides with the whiteboard pages. Mimio Virtual Ink • Everything the instructor writes on the whiteboard is captured by the Mimio hardware and software.
Automatic Data Collection Omnidirectional Lens • Captures a 360° view of the classroom. • Captures both video and audio.
Intelligent Post-Processing • Video Processing • Media Synchronization • Connecting Powerpoint Slides and Whiteboard Images • Connecting Powerpoint Slides and Instructor Images
Intelligent Post-Processing Video Processing • 360° field of view is converted to a panoramic view. (currently cylindrical panoramic)
Intelligent Post-Processing Media Synchronization • The PowerPoint slides, whiteboard pages, and video/audio are synchronized using the time information in the PowerPoint log files, whiteboard log files, and the video/audio streams.
Intelligent Post-Processing Connecting PowerPoint Slides and Whiteboard Images • To connect the PowerPoint slides, the instructor marks the four corners of the PowerPoint projection on the whiteboard. Since they lie on the same plane, we use a projective transformation to connect the two. • When a portable presentation device may be moved, a video camera is used for dynamic registration of the two sources.
Intelligent Post-Processing Connecting PowerPoint Slides and Instructor Images • Actual video of the instructor is merged to the digital PowerPoint slides. The instructor is extracted from the video using computer vision techniques, and then merged to the slides. • Gives the students the relation between the instructor and the visual aids used.
Natural Interaction • Virtualized Classroom Presentation System • VCPS Creator • VCPS Player
Natural Interaction Virtualized Classroom Presentation Creator • The Virtual Classroom Presentation Creator is fully customizable. The user can decide which presentation components should be included.
Natural Interaction Virtualized Classroom Presentation Player • The Virtual Classroom Presentation Player allows the user to load the presentation file. The user can access the Table of Contents by right-clicking the mouse.
How Can We Take It To The Streets • Automatic Data Collection • Intelligent Post-Processing • Natural Interaction between traffic management and the traffic
Traffic: Automatic Data Collection Currently:
Traffic: Automatic Data Collection By using an omnidirectional camera, we can get live traffic view in all directions. Pros: 360° point of view. More information is available from one source. Cons: Requires physical installation of camera. Pictures may have some distortion.
Traffic: Intelligent Post-Processing After data is collected, we should be able to determine a busy street or highway. Using background subtraction, we should be able to obtain similar results. heavy traffic light traffic
Traffic: Natural Interaction Like the Virtualized Classroom Presentation Player, traffic management should be able to easily view traffic information that is received. Table of Contents (possibly show map and camera locations) New York City Map Camera View
From Virtual Classroom to the Virtual Streets Emmanuel Velasco City College of New York Capstone 1 Fall 2004