Introduction of Multimedia

1. Introduction of Multimedia Edmodo : CIT453 Spring2017 (Group Code – yebhyy) Chapter 1

2. Topics • Introduction on multimedia. • Multimedia Systems • Overview of multimedia software tools, and Authoring tools

3. Multimedia?

4. What is Multimedia? • Multimedia can have many definitions these includes: • A computer system perspective definition: • Multimedia means that computer information can be represented through audio, video, and animation in addition to traditional media (i.e., text, graphics/drawings, images).

5. General Definition • A good general working definition: • Multimedia is the field concerned with the computer controlled integration of text, graphics, drawings, still and moving images (Video), animation, audio, and any other media where every type of information can be represented, stored, transmitted and processed digitally.

6. What is HyperText and Hypermedia? • Hypertext is a text which contains links to other texts. The term was invented by Ted Nelson around 1965.

7. HyperText Navigation • Traversal through pages of hypertext is therefore usually non-linear (as indicated below). • This has implications in layout and organisation of material — and depends a lot on the application at hand.

8. Hypermedia • HyperMedia is not constrained to be text-based, can include other media, e.g., graphics, images, and especially the continuous media - sound and video.

9. Linear vs non-linear • Linear Multimedia is a type of a multimedia that is designed to be presented in a sequential manner. • Examples may be: • A powerpointpresentation • A storyline/ A movie • An anime episode • A Youtube video

10. Linear vs non-linear Multimedia (cont’d) • Non-linear multimedia is a non-sequential type of multimedia where the person’s participation is crucial. • In this type of media, the person needs to interact with a computer program, thus making him in control of the experience. • Examples may include: • A Website • A search engine’s home page • A DvD menu screen • A YoutubeChannel

11. Multimedia Application & Systems

12. Multimedia Application Definition A MultimediaApplicationis an application which uses a collection of multiple media sources e.g. text, graphics, images, sound/audio, animation and/or video.

13. Multimedia Systems • A Multimedia System is a system capable of processing multimedia data and applications. • A Multimedia System is characterised by the processing, storage, generation, manipulation and rendition of Multimedia information.

14. Example of Multimedia Systems1. Video teleconferencing. A communication technology that permits users at 2 or more different locations to interact by creating a face-to-face meeting environment

15. 2. Distributed lectures for higher education. Recorded lecture videos are distributed to students via the LMS (Learning Management System). Another example is YouTube.

16. 3. Tele-medicine. Doctors consult via real-time video

17. 4. Co-operative work environments. Working in the Virtual/Physical World which run video skype continuously during office hours

18. 5. Searching in (very) large video and image databases for target visual objects.

19. 6. " Augmented" reality: placing real-appearing computer graphics and video objects into scenes.

20. 7. Using voice-recognition to build an interactive environment, say a kitchen-wall web browser.

21. 8. Video-on-demand systems which allow users to select and watch/listen to video or audio content such as movies and TV shows when they choose to, rather than having to watch at a specific broadcast time

22. 9. Computer games • Competitive game, e.g. E-Sports. Gamers compete in the Grand Finals of The International Dota 2 Championships videogame competition at Seattle’s Key Arena.

23. 10. WWW • Education • Business (Online shopping) • Google Maps

24. Characteristics of a Multimedia System A Multimedia system has four basic characteristics: • Multimedia systems must be computer controlled. • Multimedia systems are integrated. • The information they handle must be represented digitally. • The interface to the final presentation of media is usually interactive.

25. Challenges for Multimedia Systems • Distributed Networks • when the computer programming and the data to be worked on are spread out across more than one computer. Usually, this is implemented over a computer network. Temporal relationship between data • Render different data at same time — continuously. • Sequencing within the media: playing frames in correct order/time frame in video • Synchronisation— inter-media scheduling E.g. Video and Audio — Lip synchronisation is clearly important for humans to watch playback of video and audio and even animation and audio. Ever tried watching an out of (lip) sync film for a long time?

26. Key Issues for Multimedia Systems The key issues multimedia systems need to deal with here are: • How to represent and store temporal information. • How to strictly maintain the temporal relationships on play back/retrieval • What process are involved in the above. • Data has to represented digitally — Analog–Digital Conversion, Sampling etc. • Large Data Requirements — bandwidth, storage, Data compression is usually mandatory

27. Desirable Features for a Multimedia System Given the above challenges the following feature a desirable (if not a prerequisite) for a Multimedia System: Very High Processing Power — needed to deal with large data processing and real time delivery of media. Special hardware common place. Multimedia Capable File System — needed to deliver real-time media — e.g. Video/Audio Streaming. Special Hardware/Software needed – e.g. RAID technology. Data Representations — File Formats that support multimedia should be easy to handle yet allow for compression/decompression in real-time.

28. RAID – Redundant Array of Independent Disks • a data storage virtualization technology that combines multiple disk drive components into a logical unit for the purposes of data redundancy or performance improvement

29. Desirable Features for a Multimedia System (cont.) Efficient and High I/O — input and output to the file subsystem needs to be efficient and fast. Needs to allow for real-time recording as well as playback of data. e.g. Direct to Disk recording systems. (Live in Social Media) Special Operating System — to allow access to file system and process data efficiently and quickly. Needs to support direct transfers to disk, real-time scheduling, fast interrupt processing, I/O streaming etc.

30. Desirable Features for a Multimedia System (cont.) • Storage and Memory — large storage units (of the order of hundreds of Tb if not more) and large memory (several Gb or more). Large Caches also required and high speed buses for efficient management. • Network Support — Client-server systems common as distributed systems common. • Software Tools — user friendly tools needed to handle media, design and develop applications, deliver media.

31. Components of a Multimedia System Now let us consider the Components (Hardware and Software) required for a multimedia system: Capture devices — Video Camera, Video Recorder, Audio Microphone, Keyboards, mice, graphics tablets, 3D input devices, tactile sensors, VR devices. Digitising Hardware Storage Devices — Hard disks, CD-ROMs, DVD-ROM, etc Communication Networks — Local Networks, Intranets, Internet, Multimedia or other special high speed networks. Computer Systems — Multimedia Desktop machines, Workstations, MPEG/VIDEO/DSP Hardware Display Devices — CD-quality speakers, HDTV,SVGA, Hi-Res monitors, Colour printers etc

32. Overview of Multimedia Software and Authoring Tools

33. software tools available for carrying out tasks in multimedia are: 1. Music Sequencing and Notation 2. Digital Audio 3. Graphics and Image Editing 4. Video Editing 5. Animation 6. Multimedia Authoring

34. 1.Music Sequencing and Notation • Cakewalk: now called Pro Audio. - The term sequencer comes from older devices that stored sequences of notes ("events", in MIDI [Musical Instrument Digital Interface]). • It is also possible to insert WAV files and Windows MCI commands (for animation and video) into music tracks (MCI is a ubiquitous component of the Windows API.) • Cubase: another sequencing/editing program, with capabilities similar to those of Cakewalk. It includes some digital audio editing tools. • Macromedia Soundedit: mature program for creating audio for multimedia projects and the web that integrates well with other Macromedia products such as Flash and Director.

35. 1.Music Sequencing and Notation • Cakewalk: now called Pro Audio. • The term sequencer comes from older devices that stored sequences of notes (“events”, in MIDI) • Possible to insert WAV files and Windows MCI commands (for animation and video) into music tracks (MCI is a ubiquitous component of the Windows API.)

37. 1.Music Sequencing and Notation(cont) • Cubase • sequencing/editing program, with capabilities similar to those of Cakewalk • includes some digital audio editing tools • Adobe Soundbooth • mature program for creating audio for multimedia projects and the web that integrates well with other Adobe products such as Flash and Director

38. 2.Digital Audio • tools deal with accessing and editing the actual sampled sounds that make up audio: • Adobe Audition (formerly Cool Edit) is a powerful, popular digital audio toolkit that emulate a professional audio studio, including multitrack productions and sound file editing, along with digital signal processing effects. • Sound Forge Like Audition, Sound Forge is a sophisticated PC-based program for editing WAV files. • Pro Tools: a high-end integrated audio production and editing environment . It offers MIDI creation and manipulation; powerful audio mixing, recording, and editing software.

39. 3. Graphics and Image Editing • Adobe Illustrator • Powerful publishing tool from Adobe. Uses vector graphics; graphics can be exported to Web • Adobe Photoshop • Standard in a graphics, image processing and manipulation tool • Layers of images, graphics, and text that can be separately manipulated for maximum flexibility • Filter factory permits creation of sophisticated lighting-effects filters

40. 3. Graphics and Image Editing (cont’d) • Adobe Fireworks • Software for making graphics specifically for the web • Adobe Freehand • A text and web graphics editing tool that supports many bitmap formats such as GIF, PNG, and JPEG

41. 4. Video Editing • Adobe Premiere: an intuitive, simple video editing tool for nonlinear editing, i.e., putting video clips into any order: - Video and audio are arranged in "tracks". - Provides a large number of video and audio tracks, super-impositions and virtual clips. • A large library of built-in transitions, filters and motions for clips => effective multimedia productions with little effort. • Adobe After Effects: a powerful video editing tool that enables users to add and change existing movies. Can add many effects: lighting, shadows, motion blurring; layers.

43. 4. Video Editing (cont’d) • Adobe After Effects : a powerful video editing tool that enables users to add and change existing movies. Can add many effects: lighting, shadows, motion blurring; layers • Final Cut Pro: a video editing tool by Apple; Macintosh only.

44. 4. Video Editing (cont’d) • iMovie : for iOS and macOS, you can enjoy your videos like never before. It’s easy to browse your clips and create Hollywood-style trailers and stunning 4K-resolution movies. You can even start editing on iPhone or iPad, then finish on your Mac.

45. 4. Video Editing (cont’d) • CyberLink PowerDirector : PowerDirector produced by CyberLink Corp. • is by far the most popular nonlinear video editing software. • It provides a rich selection of audio and video features and special effects • easy to use. • It supports all modern video formats (AVCHD 2.0, 4K Ultra HD, and 3D video) • It supports 64-bit video processing • it is not as “programmable” as Premiere.

46. 5. Animation • Multimedia APIs: • Java3D: API used by Java to construct and render 3D graphics, similar to the way in which the Java Media Framework is used for handling media files. • Provides a basic set of object primitives (cube, splines, etc.) for building scenes. • It is an abstraction layer built on top of OpenGL or DirectX (the user can select which). • DirectX : Windows API that supports video, images, audio and 3-D animation • OpenGL: the highly portable, most popular 3-D API.

47. 5. Animation • Animation Software (Rendering Tools): • 3D Studio Max: rendering tool that includes a number of very high-end professional tools for character animation, game development, and visual effects production. • Softimage XSI: a powerful modeling, animation, and rendering package used for animation and special effects in films and games. • Maya: competing product to Softimage; as well, it is a complete modeling package. • RenderMan: rendering package created by Pixar.

49. 5. Animation • GIF Animation Packages : • simpler approach to animation, allows very quick development of effective small animations for the web. • GIFs can contain several images, and looping through them creates a simple animation. - Linux also provides some simple animation tools, such as animate.

50. 6. Multimedia Authoring • Tools that provide the capability for creating a complete multimedia presentation, including interactive user control, are called authoring programs. • Use to merge multimedia elements (text, audio, graphic, animation, video) into a project • Designed to manage individual multimedia elements and provide user interaction (if required) • Tools :