430 likes | 829 Views
Introduction. Course title: Multimedia Systems and Applications Number: 131358
E N D
Introduction • Course title: Multimedia Systems and Applications • Number: 131358 • This course gives an introduction to multimedia (MM) contents and the tools used to produce MM contents. It also covers the design and production of a MM system. The students will be able to produce MM applications that can run locally and/or over a network.
Objectives • Provide students with an overview of multimedia technologies and the latest developments in multimedia systems. • Survey a variety of multimedia applications. • Students will be able to gain experience in multimedia production and design. • Create a multimedia application incorporating effective amount of text, image, video, sound, and animation as appropriate to delivery method and audience. • Create navigation paths using links, triggers, keywords, etc., to create a variety of design models.
Intended learning Outcomes • Describe the basic components of an interactive multimedia presentation and their working relationships. • Learn interactive multimedia presentation terminology. • Identify various properties of audio, image, video and animation data. • Describe examples of digital media: text, images, video, sound, and animation. Continue
Intended learning Outcomes • Demonstrate the ability to use computer software to identify, create, and manipulate different media types and authoring systems. • Define production team roles. • Select a project topic and design a map or storyboard for the topic/project. • Create or acquire the necessary media for the selected project. • Apply the MM application life cycle steps • Develop, test, and present the finished product.
Course outline • Textbook and References: • Vaughan, T. “ Multimedia Making It Work • Li, Z & Drew, M.S. “ Fundamentals of Multimedia “ • Major Topics • Multimedia terminology, production and MM applications • Life cycle of MM project • Components of MM application: text, sound, image, video, animation • Development team and the role of each member • MM authoring systems • Color terminology and schemes • Grades: • First 15% • Second 10% • Practical 10% • Project 15% • Final 50%
What is Multimedia? • When different people mention the term multimedia, they often have quite different, or even opposing, viewpoints. • A PC vendor: a PC that has sound capability, a DVD-ROM drive, and perhaps the superiority of multimedia-enabled microprocessors that understand additional multimedia instructions. • A consumer entertainment vendor: interactive cable TV with hundreds of digital channels available, or a cable TV-like service delivered over a high-speed Internet connection. • A Computer Science (CS) student: applications that use multiple modalities, including text, images, drawings (graphics), animation, video, sound including speech, and interactivity.
Digital Multimedia • What is multimedia? • Multi (numerous) • Media (medium: a substance regarded as the means of transmission of a force or effect, but this does not fit. How about Means for distribution and presentation of information) • Multiple types of information captured, stored, manipulated, transmitted, and presented.
Digital Multimedia • What is multimedia? Digital Multimedia is the field (art ) concerned of putting together at least two of the following: text, images, sounds, video, animated film, and music where every type can be represented, stored, transmitted & processed digitally to create an integrated electronic presentation to be delivered using computer.
Interactive Multimedia • When you allow an end user (the viewer of a multimedia project ) to control what elements are delivered, when they are delivered and in what order they are delivered it is called interactive multimedia.
Multimedia data elements • Text • Document images • Photographic images • Geographic system maps • Sound • Voice commands • Moving graphics (animation) • Full motion video
Multimedia is Multidisciplinary Computer networks, operating system Multimedia computing Computer vision, pattern recognition Image, audio, speech processing Human computer interaction Computer graphics
Multimedia is Multidisciplinary Data Compression Multimedia computing Information Retrieval Natural Language Processing Psychology
History of Multimedia • “The implementation of multimedia capabilities in computers is the latest episode in a long series: cave painting, hand-crafted manuscripts, the printing press, radio and television . . .” • Glenn Ochsenreiter, 1992
Old presentation include • Story Telling: The story teller enhancing a story with actions and sounds • Theater • Dance: Multimedia without computer interaction • Pictorial Representations of Reality and Imagination: Images & Symbolism
Other presentation • Newspaper: perhaps the first mass communication medium, uses text, graphics, and images • Motion pictures: motion too rapid to be observe by the human eye. • Wireless radio transmission • Television: the new medium for the 20th century, established video as a commonly available medium and has since changed the world of mass communications
Recently • Power Point • DVD video was introduced; high quality full-length movies were distributed on a single disk. • The introduction of PDAs began a new period in the use of computers in multimedia • Hand-held MP3 devices holding flash memory. • Internet: WWW, Social Networks …..
What is HyperText and HyperMedia? • Hypertext is a text which contains links to other texts.
HyperText Navigation Traversal through pages of hypertext is therefore usually non-linear (as indicated below). This has implications in layout and organization of material and depends a lot on the application at hand.
Hypermedia • HyperMedia is not constrained to be text-based. It can include other media, e.g., graphics, images, and especially the continuous media - sound and video. Example WWW
Characteristics of Multimedia Applications • Multimedia system must be computer controlled • They are integrated • The information they handle must be represented digitally • The interface to final user permits interactivity
Features of a MM Computer systems • Very high processing power • A File system capable of handling multimedia information • File formats that exploit the inherent properties of the multimedia information • Efficient and high I/O rate • Multimedia operating system • Storage and memory • Network support • Software tools
Classification of Multimedia • Captured from real life verses synthesized by the computer. • Discrete space based. Example is text, verses continuous media space & time based example animation. • Linear: a non interactive project starting from at a beginning and running through to an end verses nonlinear & interactive where users are given the navigational control and they can go through the content according to their will allowing personal gateway to information
Challenges of Multimedia Computing • Developing a successful multimedia system is non-trivial. • Continuous media types such as video need a lot of space to store and very high bandwidth to transmit. • Render different data at same time — continuously • Synchronization — inter-media scheduling for example Video and Audio — Lip synchronization is clearly important for humans to watch playback of video and audio and even animation and audio. • Automatically analyzing, indexing and organizing information in audio, image and video is much harder than from text. • Multimedia involves many different research areas and needs more complex and more efficient algorithms and hardware platforms. • Distributed Networks: Bandwidth, storage, compression
Benefits of multimedia • Easy to understand & easy to use • Integrated & interactive • Flexible • Suitable to cooperative work environment • Supportive of large audience
Application Areas • Presentations • Training • Entertainment • Advertising • Reference • Learning • Simulation • Kiosks • Customer support services
Where to use multimedia? • In schools: the most needy place • Video capturing & video conferencing • Teaching process can go beyond the limits of traditional teaching methods • Reading skills grow through word recognition • Read aloud • Spelling • Learn be exploring & discovery • In-depth learning of new clinical techniques
Applications of Multimedia Systems • Scientific Applications • Data analyses • Research and development • Experimentation • Technical presentations • Instructional Applications “Almost all teaching is multimedia” (Schramm, 1977) • Teaching children to read • Teaching history • Simulations • Reference materials
Where to use multimedia? • Multimedia at home • Gardening • Cooking • Design • Remodeling • Entertainment • Play stations • TV • CD • Internet gaming zone
Where to use multimedia? • In public places: providing help & information • Hotels • Train stations • Shopping centers • Museums • Virtual realty • Places the user in the “life like” experience • Entertainment Through Multimedia Systems • Interactive games • Sports-related products
Foreseeable Future Multimedia Systems • Improved virtual reality • Interactive television • Improved video telephony • More powerful development software • Improving user interface
Text • Title and Headlines • (What's it all about) • Menus • (Where to go) • Navigation • (How to get there) • Content • (What you see when you get there)
Graphics • Reinforce text • Supplement text • Create impact • Sources: • Paint and Drawing Programs • Scanners • Photo CDs • Digital Cameras • Digital Video Stills • WWW
Computer Graphics • Bitmap • photographic • paint • Vector • drawing 63 KB 8.5 KB
Sound • Create atmosphere • Feedback • Give instructions • Give warnings • Supplement information on screen
Computer Sound • MIDI • 21KB, 2min 36s • Digital Audio • 612KB, 56s • MP3
Animation • Animation can be used to add visual impact to a Multimedia application • Visual effects, such as dissolves and wipes, can be used for primitive animation. • More complex animations are based on Cel Animation techniques. • Animations can be 2-D or 3-D
Digital Movies • AVI • Director • Quicktime • MPEG • Panoramic
Skills Mix Executive Producer Project Manager Creative Director Graphic Artist Writer Programmer Interface Designer Animator Composer Sound Designer Videographer Photographer
Multimedia- Applications In training
Multimedia- Applications Public awareness campaignSourceInteractive Multimedia Project Department of food science& nutrition, Colorado State Univ
Multimedia- Applications In MedicineSource: Cardiac Imaging,YALE centre for advanced cardiac imaging