1 / 69

Chapter 28 – Multimedia: Audio, Video, Speech Synthesis and Recognition

Chapter 28 – Multimedia: Audio, Video, Speech Synthesis and Recognition. Outline 28.1 Introduction 28.2 Audio and Video 28.3 Adding Background Sounds with the bgsound Element 28.4 Adding Video with the img Element’s dynsrc Property

louise
Download Presentation

Chapter 28 – Multimedia: Audio, Video, Speech Synthesis and Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 28 – Multimedia: Audio, Video, Speech Synthesis and Recognition Outline 28.1 Introduction 28.2 Audio and Video 28.3 Adding Background Sounds with the bgsound Element 28.4 Adding Video with the img Element’s dynsrc Property 28.5 Adding Audio or Video with the embed Element 28.6 Using the Windows Media Player ActiveX Control 28.7 Microsoft Agent Control 28.8 RealOne Player Plug-in 28.9 Synchronized Multimedia Integration Language (SMIL) 28.10 Scalable Vector Graphics (SVG) 28.11 Web Resources

  2. Objectives • In this lesson, you will learn: • To enhance Web pages with sound and video. • To use the bgsound element to add background sounds. • To use the img element’s dynsrc property to incorporate video into Web pages. • To use the embed element to add sound or video. • To use the Windows Media Player ActiveX control to play a variety of media formats in Web pages. • To use the Microsoft Agent ActiveX control to create animated characters that speak to users and respond to spoken commands from users. • To embed RealOne Player™ to include streaming audio and video in a Web page. • To embed video and create graphics in a Web page using SMIL and SVG.

  3. 28.1  Introduction • Multimedia • Use of sound, images, graphics and video • Add sound, video, and animated characters to Web-based applications • Streaming technologies • VXML: • www.studio.tellme.com. • Free registration gives full access to VXML interpreter and Tellme’s platform that runs it.   • This platform includes Nuance speech recognizer (SR) and Text-To-Speech Engine (TTS). • IBM’s WebSphere Voice Server SDK: http://www.alphaworks.ibm.com/tech/voiceserversdk • Microsoft Speech Server • http://www.microsoft.com/speech/default.mspx • http://www.microsoft.com/downloads/details.aspx?FamilyId=1194ED95-7A23-46A0-BBBC-06EF009C053A&displaylang=en

  4. 28.2  Audio and Video • Can be embedded in Web page • Can be downloaded “on-demand” • Encoding algorithm or codec • Transforms raw audio or video into a format that Web browsers can display

  5. 28.3  Adding Background Sounds with the bgsound Element • bgsound element • src property • Specifies the URL of audio clip to be played • loop property • Specifies number of times audio clip will play • balance property • Specifies balance between left and right speakers • volume property • Determines volume of audio clip

  6. BackgroundAudio.html(1 of 4)

  7. BackgroundAudio.html(2 of 4)

  8. BackgroundAudio.html(3 of 4)

  9. BackgroundAudio.html(4 of 4)

  10. 28.4  Adding Video with the img Element’s dynsrc Property • img element • Incorporates both images and videos • src property • Indicates source is image • dynsrc property • Indicates source is video clip • start property • Specifies when video should start playing • Event fileopen • Video should play as soon as it loads • Event mouseover • Video should play when user position mouse over video

  11. Dynamicimg.html(1 of 2)

  12. Dynamicimg.html(2 of 2)

  13. 28.5  Adding Audio or Video with the embed Element • Element embed • Embeds media clip into Web page • Displays a graphical user interface (GUI) • Supported by both Microsoft Internet Explorer and Netscape

  14. EmbeddedAudio.html(1 of 3)

  15. EmbeddedAudio.html(2 of 3)

  16. EmbeddedAudio.html(3 of 3)

  17. Play Pause Stop Mute Volume 28.5  Adding Audio or Video with the embed Element

  18. EmbeddedVideo.html(1 of 2)

  19. EmbeddedVideo.html(2 of 2)

  20. 28.6  Using the Windows Media Player ActiveX Control • object element • Embed Windows Media Player and ActiveX controls • Property id • Specifies scripting name of element • width and height properties • Specify width and height in pixels • property classid • Specifies ActiveX control ID • Element param • Specify parameter • Parameter FileName • Specifies file containing media clip • AutoStart (boolean value) • ShowControls (boolean value) • Loop (boolean value)

  21. HTML <object> tag • HTML <object> tag • Definition and Usage • Defines an embedded object. Use this element to add multimedia to your XHTML page. This element allows you to specify the data and parameters for objects inserted into HTML documents, and the code that can be used to display/manipulate that data. • Note: An object element can appear inside the head or the body element. The text between the <object> and </object> is the alternate text, for browsers that do not support this tag. The <param> tags define run-time settings for the object. • Tip: For images use the <img> tag instead of the <object> tag.

  22. HTML <object> tag • Optional Attributes • Attribute Value Description DTD • align leftrighttopbottom Defines the text alignment around the object TF • archive URL A space separated list of URL's to archives. The archives contains resources relevant to the object STF • border pixels Defines a border around the object TF • classid class ID Defines a class ID value as set in the Windows Registry or a URL STF • codebase URL Defines where to find the code for the object STF • codetype MIME type The internet media type of the code referred to by the classid attribute STF • data URL Defines a URL that refers to the object's data STF • declare declare Defines that the object should only be declared, not created or instantiated until needed STF • height pixels Defines the height of the object STF • hspace pixels Defines the horizontal spacing around the object TF • name unique_name Defines a unique name for the object (to use in scripts) STF • standby text Defines a text to display while the object is loading STF • type MIME_type Defines the MIME type of data specified in the data attribute STF • usemap URL Specifies a URL of a client-side image map to be used with the object STF • vspace pixels Defines the vertical spacing around the object TF • width pixels Defines the width of the object STF

  23. HTML <object> tag • Standard Attributes • id, class, title, style, dir, lang, xml:lang • Attribute Value Description • class class_rule or style_ruleThe class of the element • id id_nameA unique id for the element • style style_definitionAn inline style definition • Title tooltip_text A text to display in a tool tip

  24. MediaPlayer.html(1 of 3)

  25. MediaPlayer.html(2 of 3)

  26. MediaPlayer.html(3 of 3)

  27. 28.7  Microsoft Agent Control • Interactive animated characters • Speaks • Supports speech recognition • Microsoft Agent Character Editor • Microsoft Linguistic Sound Editing Tool • http://www.microsoft.com/msagent/downloads/ • TTS – Text To Speech Engine • Microsoft Speech Recognition Engine • Need SAPI (Speech Application Interface) from: • http://www.microsoft.com/msagent/downloads/user.asp#sapi

  28. tutorial.html(1 of 12)

  29. tutorial.html(2 of 12)

  30. tutorial.html(3 of 12)

  31. tutorial.html(4 of 12)

  32. tutorial.html(5 of 12)

  33. tutorial.html(6 of 12)

  34. tutorial.html(7 of 12)

  35. tutorial.html(8 of 12)

  36. tutorial.html(9 of 12)

  37. tutorial.html(10 of 12)

  38. tutorial.html(11 of 12)

  39. tutorial.html(12 of 12)

  40. 28.7  Microsoft Agent Control Fig. 28.7 Peedy finishing introduction.

  41. 28.7  Microsoft Agent Control Fig. 28.8 Peedy ready to receive voice commands.

  42. 28.7  Microsoft Agent Control Fig. 28.9 Peedy receiving voice command.

  43. 28.7  Microsoft Agent Control Fig. 28.10 Peedy discussing Good Programming Practices.

  44. 28.7  Microsoft Agent Control

  45. 28.7  Microsoft Agent Control

  46. 28.7  Microsoft Agent Control

  47. 28.8  RealOne Player Plug-in • Element embed • Embed RealOne Player plug-ins for video and audio • Attribute type • Specifies Multipurpose Internet Mail Extensions (MIME) type of embedded file • Attributes width and height • Specify dimensions of space the control occupies • Attribute autostart • Determines whether media start playing when page loads • Attribute controls • Specifies which controls users can access • www.audiovideoweb.com/emded_real_html.htm • Attribute src • Set to location of streaming media

  48. StreamingMedia.html(1 of 3)

More Related