1 / 53

Capstone: Vision, Video and VR

Capstone: Vision, Video and VR. Lecture 3 Project Topic 2: Virtualized Classroom. CSC 59866CD Fall 2004. Zhigang Zhu, NAC 8/203A http://www-cs.engr.ccny.cuny.edu/~zhu/ Capstone2004/Capstone_Sequence2004.html.

tsharon
Download Presentation

Capstone: Vision, Video and VR

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Capstone: Vision, Video and VR Lecture 3 Project Topic 2: Virtualized Classroom CSC 59866CD Fall 2004 Zhigang Zhu, NAC 8/203A http://www-cs.engr.ccny.cuny.edu/~zhu/ Capstone2004/Capstone_Sequence2004.html

  2. Virtualized Classroom Automated Production Media Integration and User-Customized Presentation Zhigang Zhu1,2, Chad McKittrick1 and Weihong Li2 Video Computing Laboratory Department of Computer Science 1City College and 2Graduate Center The City University of New York

  3. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  4. new pedagogy + new technology = improved educational outcomes technology assessment experiments traditional distance learning support for students and faculty in an interdisciplinary center integration of on-campus and at-a-distance students using an embedded “intelligent” design environment active, peer and cooperative learning in introductory courses hypothesis, strategy & motivation pedagogy MDDE2004 @Zhigang Zhu /CUNY

  5. In cooperation with Ellen Smiley Dept of Psychology, School of Social Science City College of New York W. Richards Adrion James F. Kurose Edward M. Riseman RIPPLES Group and Vision Lab University of Massachusetts Amherst Dr. Parviz Kermani e-Learning Lecture Navigator (ELN) Polytechnic University of New York and IBM T.J. Watson Research Center MDDE2004 @Zhigang Zhu /CUNY

  6. UMass Multimedia Asynchronous Networked Interactive Courseware Supports a Rich Variety of Media proven technology & wide usage • Video Instructional Program • National Technological University • PINY, NCState, UMn, CCNY CD-MANIC: the best of both worlds • CDs • for bandwidth intensive content • internet for: • content updates • logging student behavior • collaboration • search • external links • overcomes any bandwidth constraints & provides convenience • contents don’t change often • use anywhere • planes, trains, behind firewalls MDDE2004 @Zhigang Zhu /CUNY

  7. CUNY and CCNY • CUNY – 20+ colleges • Ph.D. programs in GSUC • CCNY – 20, 000 students • MS programs only • Minority Serving Institute • In 2002, URM 66% in engineering, 35% in CS • US News 2003: No 2 in diversity • large percentage of work students • Questions: • Effective learning tools for recruiting and retention MDDE2004 @Zhigang Zhu /CUNY

  8. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  9. Multimedia Virtual Classroom • Automatic data collection and indexing • Audio/video • PPT, handwriting • online materials, etc • Collaborative Learning Environment (CLE) • Active • Coversational • Constructive & reflective • Intentional & contextual MDDE2004 @Zhigang Zhu /CUNY

  10. search • relevance ranked • 2nd level to repository, Web • audio, images Scene Selection MVC as an active CLE • active • Goal: active interface, navigation • base: index, simple search + extended search, active objects (text, images) + learner-controlled interface MDDE2004 @Zhigang Zhu /CUNY

  11. shared controls chat MVC as an conversational CLE • conversational • goal: support collaboration • base: threaded discussions + CLIMANIC MDDE2004 @Zhigang Zhu /CUNY

  12. HIST MVC as a constructive & reflective CLE • constructive & reflective • goal: notation, collaboration • base: none + notes on slides, threaded discussions, save CLIMANIC collaborations, integrated reporting MDDE2004 @Zhigang Zhu /CUNY

  13. MVC as an intentional & contextual CLE • intentional & complex & contextual • goal: problem-focused pedagogy & active classroom strategy, realistic problem domains • base: problem-focused learning + CASA, on-campus & distance learning integration, design tools & environment integration Integrated Tools MDDE2004 @Zhigang Zhu /CUNY

  14. logs report generator logger server internet logs logs logs MVC supporting learner logger • important tool for assessment • goal: assessing individual and course learning goals • base: quizzer, logger + integrate with new tools: extended search, notation, collaboration + extend to integrated design tools & environment + integrate with CMS (OWL, WebCT, Blackboard) MDDE2004 @Zhigang Zhu /CUNY

  15. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  16. CCNY Virtualized Classroom • Automated MM data capture • Sensing, synchronization and recording • Intelligent MM data integration • Video, PPT slides, Mimio handwriting pages • Flexible User Interface • Course adaptive, user customized • Virtualized Classroom (VC) • A new e-learning environment generated and enhanced from materials captured from real classrooms. MDDE2004 @Zhigang Zhu /CUNY

  17. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  18. conversion index PPT Capture Add-on registration Mimio Virtual Ink video transformation Remote Reality Omnidirectional Camera VC: Automatic MM capture MDDE2004 @Zhigang Zhu /CUNY

  19. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  20. VC: Media Integration • PPT@ Slide & Mimio page registration • Pre-calibration • Dynamic calibration • Panoramic Video Mosaicing • From a panning camera • PPT@ Slide & video image registration • Toward a 3D virtual environment MDDE2004 @Zhigang Zhu /CUNY

  21. VC: Media Integration (1) PPT@ Slide & Mimio page registration A simple approach: mark four corners … MDDE2004 @Zhigang Zhu /CUNY

  22. VC: Media Integration (1) PPT@ Slide & Mimio page registration A simple approach: mark four corners … MDDE2004 @Zhigang Zhu /CUNY

  23. VC: Media Integration (1) PPT@ Slide & Mimio page registration Question: What if one of the devices move? MDDE2004 @Zhigang Zhu /CUNY

  24. VC: Media Integration (1) • Dynamic registration of PPT@ Slide & Mimio page because • Hard to mark in some cases • due to occlusion and height • Instructor may forget to do it • Devices may not be able to keep stationary • Camera, projector, Mimio capture bar • completely automatic and “mind-free” approach MDDE2004 @Zhigang Zhu /CUNY

  25. video PPT slides Handwriting pages S V1 H V2 combined

  26. VC: Media Integration (2) Panoramic mosaic from video MDDE2004 @Zhigang Zhu /CUNY

  27. VC: Media Integration (2) Panoramic mosaic from video MDDE2004 @Zhigang Zhu /CUNY

  28. Active WWW link Synthetic Hi-Res digital display Slide combined with video Panoramic mosaic from video Annotated and active instructor VC: Media Integration Toward an immersive VC interface Question Window, ToC, etc MDDE2004 @Zhigang Zhu /CUNY

  29. VC: Media Integration (3) Replacing the slide projections MDDE2004 @Zhigang Zhu /CUNY

  30. VC: Media Integration (3) Image Alignment From Video From Digital Slide (PPT) MDDE2004 @Zhigang Zhu /CUNY

  31. VC: Media Integration (3) Image Alignment MDDE2004 @Zhigang Zhu /CUNY

  32. VC: Media Integration (3) Instructor Extraction… MDDE2004 @Zhigang Zhu /CUNY

  33. VC: Media Integration (3) Instructor Extraction…raw MDDE2004 @Zhigang Zhu /CUNY

  34. VC: Media Integration (3) Instructor Extraction…refined MDDE2004 @Zhigang Zhu /CUNY

  35. VC: Media Integration (3) Instructor Extraction…contour MDDE2004 @Zhigang Zhu /CUNY

  36. VC: Media Integration (3) Instructor Extraction…and integration video image shadow contour MDDE2004 @Zhigang Zhu /CUNY

  37. Active WWW link Synthetic Hi-Res digital display Slide combined with video Panoramic mosaic from video Annotated and active instructor VC: Media Integration Toward an immersive VC interface Question Window, ToC, etc MDDE2004 @Zhigang Zhu /CUNY

  38. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  39. User Customized Presentation • Virtualized Classroom Presentation System (VCPS) in Java, consists of • An authoring tool – VCPS creator • An presentation interface - VCPS player • Features • Customized sizes and locations • Pop up ToC for indexing • Synchronized play, next, last… MDDE2004 @Zhigang Zhu /CUNY

  40. User Customized Presentation • PPT+ panoramic view + popup ToC MDDE2004 @Zhigang Zhu /CUNY

  41. User Customized Presentation • PPT & Mimio integrated +Popup ToC MDDE2004 @Zhigang Zhu /CUNY

  42. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  43. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  44. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  45. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  46. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  47. User Customized Presentation • PPT+ Mimio + Combined + images +New Buttons MDDE2004 @Zhigang Zhu /CUNY

  48. Outline • Background • A Bigger Picture • Multimedia Virtual Classroom (UMass+CCNY) • CCNY Virtualized Classroom • Automatic MM capture • intelligent media integration • user-customized presentation • Conclusions and Discussions MDDE2004 @Zhigang Zhu /CUNY

  49. Conclusions and Discussions • CCNY Virtualized Classroom • automatic MM capture • intelligent media integration • user-customized presentation • Multimedia Virtual Classroom (UMass+CCNY) • Active and collaborative learning • Content-based searching and indexing • Pedagogy and assessment MDDE2004 @Zhigang Zhu /CUNY

  50. Demos • CCNY Virtualized Classroom System • UMass CD-MANIC with enhanced searching MDDE2004 @Zhigang Zhu /CUNY

More Related