130 likes | 234 Views
Annotation, Retrieval, Synchronization, and Presentation of Lecture Document. Ronen Vaisenber, Zohrab Basmajian, Phong Pham, Keith Mogensen, Arjun Satish Mentors: Prof. Sharad Mehrotra, Prof. Ramesh Jain. Research Problem.
E N D
Annotation, Retrieval, Synchronization, and Presentation of Lecture Document Ronen Vaisenber, Zohrab Basmajian, Phong Pham, Keith Mogensen, Arjun Satish Mentors: Prof. Sharad Mehrotra, Prof. Ramesh Jain
Research Problem • The problem of browser capability to support multimedia content and synchronization • Browsers stay light weight, secure, and reliable. Hence, not many standards are implemented • Design and Implement a new system to support annotation, retrieval, synchronization, and presentation of lecture documents.
Broader Impact/Research Definition • Why lecture management system? • Unstructured data collected from sensors are much of interest to RESCUE project • There are lots of unstructured data available to us on large scale • What’s the overall broad impact? • Experience gained from this work will give other researchers insight on how multimedia repositories should be managed. For example • Recording of 911 calls • Communication between fire fighters between during big California fires
The Method • SMPL – “Simple Multimedia Presentation Language” • A declarative, script free, definition file that can be generated automatically, and defines multimedia presentation. • It extends SMIL standard, supports W3C standard, and compatible by all browsers. • What’s the benefit of SMPL? • It supports the definition of table of contents • It supports the usage of bookmarks • It supports the definition terms/Search-able keywords • It supports the easy authoring of presentation documents by editing XML file.
Alternative Solutions? • Plug-ins • Application that interacts with a browser to add a specific functionality • An alternative for SMPL • Disadvantage: • The browser is independent of the plug-ins • They have limited interactions with rest of the page’s content • Scripting • Hard to author and maintain • Adding features to the browser’s internal code • It will increase the size of the application and decrease reliability
SMPL – Core Functionalities • Fusion • Synchronization of videos with slides or any other contents such as text or html • Navigation • High level overview by means of table of contents and searchable index/terms • Manageable • Easy to manage by just editing XML file, which defines EVERYTHING in presentation • Accessible • Easy support for all browsers and implemented on top of SMIL standard and follows W3C standards a
Example: MIT Online Course Won’t it be nicer to have a structured document instead of this cluttered page? Information Fusion is Needed:
Conference <?xml version="1.0" encoding="UTF-8"?> <!ELEMENT rak (toc*)> <!ELEMENT toc (toc | smilObject+)> <!ELEMENT smilObject (smil, previewSlides*, bookmark*, keywordList?)> <!ELEMENT smil (#PCDATA)> <!ELEMENT previewSlides (time, (previewSlides | preview))> <!ELEMENT preview (time, comment?, image?)> <!ELEMENT bookmark (time, comment)> <!ELEMENT keywordList (term*)> <!ELEMENT term (time, comment)> <!ELEMENT space (#PCDATA)> <!ELEMENT image (#PCDATA)> <!ELEMENT comment (#PCDATA)> <!ELEMENT time (#PCDATA)> Session 1 Session 2 SMPL - The Lecture Document in XML SMIL – Talk 1 Session 3 Talk 1 Slide 1, t=0 Talk 2 Slide 2, t=5 Bookmark- t=76 SMIL – Talk 2 Introduction, t=0 Slide 1,t=0 Slide 2, t=10 Slide 17, t=114 Conclusions, t=114 Slide 18, t=118 Slide 19, t=120
SURF-IT Experience • Gain research experience, and solve real-world complex projects. • Learn new technologies/concepts such as working with DTD, design XML file, using google web tool kit, Programming in Java Enterprise Edition (J2EE), and etc. • Some of the tasks I have completed during this summer: • Design and Implement SMPL language • Design and Implement Oracle Database schema • Programming in JAVA and Google web tool kit to develop UI Interface and add additional features such as bookmark • Utilized the following technologies: DTD, XML, Google Web Tool Kit, JAVA EE, Oracle database, AJAX, JavaScript, HTML, and etc.
Additional Work? • Is there additional actions beyond this summer effort? • Of Course!!! It’s a research • Some of the actions are” • Utilize web application framework (Spring, Hibernate, Struts) to make the system more maintainable • Generate Web Traffic to truly test the system under heavy traffic by using tools such as JMeter • Add extra annotations and features such as comment area, private bookmarks, and much more. • The current system supports Power Point Presentations. It would be nice to support additional types such as PDF, Flashes, and so on. • List goes on and on……
Congratulations!! • Thanks for SURF-IT and all the coordinators • Special thanks to Ronen, Professor Sharad, Arjun, Keith, and Phong
Demo • Ready for Demo??