Multimedia Information Course Overview: Media Theory & Design Practice

1. Lecture 01: Introduction IS246Multimedia Information Prof. Marc Davis UC Berkeley SIMS Monday and Wednesday 3:30 pm – 5:00 pm Fall 2003 http://www.sims.berkeley.edu/academics/courses/is246/f03/

2. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

3. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

4. Who Am I? • Assistant Professor at SIMS (School of Information Management and Systems) • Background

5. Why Am I Here? • Creating technology and applications that will enable daily media consumers to become daily media producers • Research and teaching in the theory, design, and development of digital media systems for creating and using media metadata to automate media production and reuse

6. Student Introductions • Who are you? • Name • Undergrad degree and current department • Special areas of expertise and interest • Why are you here? • What you want to learn from the course

7. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

8. Global Media Network • Digital media produced anywhere by anyone accessible to anyone anywhere • Today’s media users become tomorrow’s media producers • Not 500 Channels — 500,000,000 multimedia Web Sites

9. What is the Problem? • Today people cannot easily find, edit, share, and reuse media • Computers don’t understand media content • Media is opaque and data rich • We lack structured representations • Without content representation (metadata), manipulating digital media will remain like word-processing with bitmaps

10. Types of Multimedia Data • 1D • Audio (speech, music, sound effects, etc.) • MIDI • 2D • Photographs • Graphics • 3D • Video (2D + Time) • Animation (2D + Time) • Computer graphic models • 4D • Computer graphic model animation (3D + Time)

11. Moore’s Law for Cameras 2000 2002 $400 Kodak DX4900 Kodak DC40 $ 40 SiPix StyleCam Blink Nintendo GameBoy Camera

12. Nokia 3650 Phone

13. The Media Problem • Vastly more media will be produced • Without ways to manage it (metadata creation and use) we lose the advantages of digital media • Most current approaches are insufficient and perhaps misguided • Great opportunity for innovation and invention • Need interdisciplinary approaches to the problem

14. Automatic Audio-Video Synchronization Raw Celery Chopping Video U2 “Numb” Audio Unsynched Numb Celery Music Video Synched Numb Celery Music Video

15. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

16. Goals of the Course • Acquire theoretical and practical foundations to analyze, design, and produce multimedia information systems • Media theory • Media practice • Current and future media systems and applications • Learn to apply media theory to media design • Gain further experience in project-based learning and teamwork • Develop an enduring framework and methodology for media analysis and design

17. What This Course Is • Graduate level lecture/seminar/studio in multimedia information • Highly interdisciplinary • Information Management and Systems, Computer Science, Electrical Engineering • Film Studies, Cognitive Science, Linguistics • Film Practice, Design, HCI • Project-based and team-oriented • Requires stretching, commitment, and active participation

18. What This Course Is Not • Topics • Computer science or engineering course on media signals and systems • Film criticism course • Advanced media production skills course • Media networking, protocols, compression course • Methods • Exams

19. Who This Course Is For • Students from • SIMS • Film Studies • EECS • Law, Business, Journalism, Architecture • Other departments • Interested in • Synergizing a variety of disciplinary approaches to a complex, important, and fascinating problem domain that will shape the future of human communication, technology, and culture

20. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

21. Course Format • Most classes will be lecture/discussion sessions • Lecture ~50 minutes • Discussion ~30 minutes • For each class two students will prepare discussion questions and help lead discussion • Some classes will be working sessions • Assignment 3 Overview and Ideation • Annotated Storyboard Working Session and Crit • Final Project Overview and Ideation • Some classes will be student presentations • Media Production and Theory Presentations • Final Project Presentations

22. Course Overview • Course phases • Theoretical and practical foundations • Current issues and methods • The future of multimedia • Course assignments • Theory application • Using a camcorder • Short media production • Final project

23. Course Sessions 01-14 • Theoretical and practical foundations • Communications theory and semiotics (Reddy, Iser, Barthes, Saussure) • Formalist media theory (Bordwell, Kuleshov) • Semiotic media theory (Metz, Eco) • Integrating theory and practice (Eisenstein) • Video production overview (Guest: Rachel Strickland) • Audio production overview (Guest: Rachel Strickland) Theory and history of computation (Hillis, Winograd) • Computational media theory (Manovich, Dorai & Venkatesh, Bloch)

24. Course Sessions 15-25 • Current issues and methods • Metadata for media (Davenport, Davis) • Automated media analysis (Agrain, Jain, Foote) • Multimedia journalism (Guest: Paul Grabowicz) • Media asset management and reuse process (Christel, Dimitrova, Prelinger, Jenkins) • Commercial editing systems (Adobe Premiere) • Commercial media asset management systems (Virage) • Research multimedia systems (FotoFile, Informedia) • Multimedia standards (MPEG-7)

25. Course Sessions 26-29 • The future of multimedia • Future of multimedia information technology (Bush, McLuhan, Davis, Chang) • Active capture (Davis, Nack, Barry) • Adaptive media (Davis, Stern, Varian) • Final project presentations

26. Course Assignments • Theory application • Using a camcorder: “Object lesson” • Short media production • Annotated storyboard and goal statement • Rough edit • Presentation • Final project • Team and idea formation • Project proposal • Project design specifications • Project presentation and write-up

27. Grading • 20% Theory Application Assignment • 20% Mini Media Production Project • 40% Final Project • 20% Class Participation

28. Hardware Terabyte file server Gigabit Ethernet 2 Mac G4 workstations 2 PC workstations Various audio/video input options 5 Sony DCR-TRV50 DV camcorders 5 Audio field recording packs Greenscreen Software Adobe Premiere Adobe AfterEffects Adobe PhotoShop FinalCut Pro Media Streams Collaboration tools Brainstorming area Wall whiteboards SIMS Digital Media Studio

29. IS246 Teaching Team Professor Marc Davis Head TA Ana Ramirez SIMS Studio Manager Jeremy Kashnow Consulting TA Vivien Petras

30. Office Hours • Marc Davis • Thursdays 2:00 pm – 4:00 pm • And by appointment • TAs • TBA

31. Today’s Agenda • Introductions • Problem Domain • Goals of Course • Course Overview • Action Items for Next Time

32. Purchase Course Materials • Purchase Course Reader at Copy Central on Bancroft after Thursday • Purchase Course Textbook • David Bordwell and Kristin Thompson. Film Art: An Introduction. 7th Edition. McGraw Hill, New York, 2003.

33. SIMS/CIS Computer Orientation • Fill out SIMS/CIS Account Request Form in class • See Roberta Epstein on the second floor of South Hall to get SIMS/CIS orientation

34. Readings for Next Time • Wednesday 08/27 • Michael Reddy: “The Conduit Metaphor: A Case of Frame Conflict in Our Language about Language” • Wolfgang Iser: “The Reading Process: A Phenomenological Approach” • Roland Barthes: “The Death of the Author” • Roland Barthes: “From Work to Text”