1 / 31

The Open Video Digital Library: Balancing Theory and Practice

Explore the challenges of combining DL research with a production-level DL. Learn about the Open Video DL's vision, production process, research process, and redesign based on user studies. Find out about agile interface design, user studies, and the ongoing work in the field. Discover the tools and methods used for digitization, segmentation, metadata, and more in the Open Video ecosystem.

peteri
Download Presentation

The Open Video Digital Library: Balancing Theory and Practice

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The Open Video Digital Library: Balancing Theory and Practice JBIDI 2003 Gary Marchionini University of North Carolina at Chapel Hill, USA march@ils.unc.edu Alicante, Spain November 10-12, 2003

  2. Outline • Challenge: Combining DL research with a production-level DL • Overview of the Open Video DL • The Production Process • The Research Process • Open Video Redesign based on User Studies and challenges of sustainability

  3. Open Video Vision/Contributions • An open repository of video files that can be re-used in a variety of ways by the education and research communities • Encourages contributions • A testbed for interactive interfaces • An easy to use DL based upon the agile views interface design framework • Multiple, cascading, easy to control views (pre, over, re, shared, peripheral) • Views based upon empirically validated surrogates • An environment for building theory of human information interaction • A set of methods and metrics that reveal how people understand digital video through surrogates

  4. Background & Status • Begun 1995 with colleagues at UMD & BCPS • Current funding: NSF# IIS-0099538 • Collaborators/Contributors: I2-DSI, ibiblio, CMU, UMD, NIST, Internet Archive, NASA • ~ 0.5 TB of content • ~2000 video segments • ~1500 different titles • ~4000 unique visitors per month (20,000 in Oct 03) • I2-DSI video channel • MPEG-1, MPEG-2, MPEG-4, QT • OAI provider • Ongoing user studies

  5. Agile Views Interface Research • Provide a variety of access representations (e.g., indexes) and control mechanisms • Usual search and browse capabilities • Leverage both visual and linguistic cues • Create and test surrogates for overview preview, shared and history views

  6. Open Video Release 2 • Incorporate more visual surrogates • Improve search options • Add recommendations • Improve contributions forms • Save results/partitions • Provide user registration • Provide help/descriptions

  7. Open Video Server Distributed Files Database (MySQL) AVI Search Client (Browser & Apps) MPEG etc. Browse Contribute MPEG etc. MPEG etc. Digitization Segmentation Keyframe Extraction Production System Keyword (text) Keyword (audio) Surrogates Metadata

  8. Acquisitions • Contributors provide tapes (e.g., HCIL, Prelinger, NASA) • Digitize • Add metadata • Contributors provide files & metadata (e.g., Informedia) • Crawl trusted sites (Internet Archive, LoC) • Individual contributions

  9. Surrogate Creation • Segmentation • Manual • Automatic (interframe grayscale correlation) • Keyframe extraction • MERIT (UMD) • VAST (nth frames, export QuickTime fast forwards) • Various scripts for managing GIFs, JPEGs, assemblying storyboards

  10. Web Database • MySLQ database • Metadata tables • PHP middleware • Contribution forms • Administrative tools • Logging • Demos • Related web objects • Backups

  11. Other Tools in the DL Toolkit • ISEE • Asynchronous remote use of video • Video player, chat tool, shared browser • Linked via time codes • VIVO (video indexing and visual organizer) • Multi-level indexing with inheritance (collection, video, segment, scene, shot, frame) • Manual frame extraction • Peer to Peer Sharing

  12. User Study Framework

  13. The Surrogates • Storyboard with text keywords (20-36 per board@ 500 ms) • Storyboard with audio keywords • Slide show with text keywords (250ms repeated once) • Slide show with audio keywords • Fast forward (~ 4X) • Fast forwards 32X, 64X, 128X, 256X • Poster frames • Real time clips • Text titles

  14. Surrogate Examples

  15. Metrics

  16. User Studies • Study 1: Qualitative Comparison of Surrogates (ECDL 02) • Study 2: Fast Forwards (JCDL 03) • Study 3: Narrativity (CHI 02) • Study 4: Shared views and History Views (Geisler dissertation) • Study 4: Poster frames and text (eyetracking, CIVR 03) • Study 5: TREC evaluation • Current studies • Hughes MP, Gruss MP • Redesign effects and integration of surrogates in AV

  17. Example: Coney Island: 9:19 at 32X

  18. How Much Affection 19:48 at 64X

  19. Iran 14:00 at 128X

  20. On the Run 14:09 at 256X

  21. The Challenges Ahead • Sustain system give usage and new contributions • Preserve the files and behaviors • Extend research on how people understand videos through surrogates

  22. http://www.open-video.org • Marchionini, G. & Geisler, G. (2002). The Open Video Digital Library. dLib Magazine, 8(12). http://www.dlib.org/dlib/december02/marchionini/12marchionini.html • Marchionini, G. (2003). Video and Learning Redux: New Capabilities for Practical Use. Educational Technology, March 2003. • Slaughter, L., Marchionini, G. & Geisler, G. (2000). Open Video: A Framework for a Test Collection. Journal of Network and Computer Applications, 23(3), 219-245. • Wildemuth, B. Marchionini, G., Wilkens, T., Yang, M., Geisler, G., Fowler, B., Hughes, A., & Mu, X. (2002). Alternative Surrogates for Video Objects in a Digital Library: Users’ Perspectives on Their Relative Usability. Proceedings of the 6th European Conference ECDL 2002 on Research and Advanced Technology for Digital Libraries, Berlin: Springer. (Rome, September 16-18, 2002) 493-507. • Geisler, G., Marchionini, G.,Wildemuth, B., Hughes, A., Yang, M., Wilkens, T., & Spinks, R. (2002). Video browsing interfaces for the Open Video Project. Proceedings of CHI 02, Extended Abstracts (Minneapolis, MN, April 20-25, 2002). NY: ACM Press. 514-15. • Wildemuth, B., Marchionini, G., Yang, M., Geisler, G., Wilkens, T., Hughes, A. & Gruss, R. (accepted). How fast is too fast? Evaluating fast forward surrogates for digital video, JCDL 2003. • Geisler, G. (2003). AgileViews: A Framework for creating more effective information seeking interfaces. Unpublished doctoral dissertation, UNC-Chapel Hill. • Nelson, Michael L., Marchionini, Gary, Geisler, Gary, and Yang, Meng (2001). "A Bucket Architecture for the Open Video Project [short paper]." JCDL ’01, ACM - IEEE Joint Conference on Digital Libraries (June 24-28, 2001, Roanoke, Virginia). • Geisler, Gary, and Gary Marchionini (2000). The Open Video Project: A Research-Oriented Digital Video Repository [short paper]. In Digital Libraries '00: The Fifth ACM Conference on Digital Libraries (June 2-7 2000, San Antonio, TX). New York: Association for Computing Machinery, 258-259.

More Related