1 / 25

Audio/Video Device Guidelines For The Microsoft Real Time Communication Platforms

Audio/Video Device Guidelines For The Microsoft Real Time Communication Platforms. Regis J. Crinon, Ph.D. Lead Program Manager Real Time Media Group Microsoft Corporation. Session Outline. The Real Time Media communication revolution The Road to higher quality Codecs Signal Processing

oakes
Download Presentation

Audio/Video Device Guidelines For The Microsoft Real Time Communication Platforms

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Audio/Video Device Guidelines For The Microsoft Real Time Communication Platforms Regis J. Crinon, Ph.D.Lead Program ManagerReal Time Media GroupMicrosoft Corporation

  2. Session Outline • The Real Time Media communication revolution • The Road to higher quality • Codecs • Signal Processing • Emergence of a market for Real Time Communication (RTC) devices • An opportunity to work together • Draft guidelines • Demos • Call To action

  3. The Real Time Media Communication Revolution • Internet Protocol (IP) networks are emerging as the prevalent means to communicate in real time • Increasing collaboration and exchange of multimedia information over corporate and public IP networks • IP telephony is now a viable alternative to Public Switched Telephone Network (PSTN) services • Session Initiation Protocol (SIP) enables rich multimedia sessions between multiple end-points • Quality of service is of prime importance

  4. The Road To Higher QualitySpeech codecs RTAudio (12-32 kbits/sec) RTAudio (6-12 kbits/sec) Siren, G.722.1 (16/24 kbits/sec) G.726 (32 kbits/sec) G.711 (64 kbits/sec) Narrowband PSTN networks (8 kHz sampling) Wideband IP networks (16 kHz sampling)

  5. The Road To Higher QualityAudio capture pipeline Capture AEC Analog AGC Digital AGC VAD NS AGC: Automatic Gain Control AEC: Acoustic Echo Cancellation NS: Noise Suppression VAD: Voice Activity Detection RTAudio encoder

  6. The Road To Higher QualityVideo codecs RT Video @ 200kbits/sec RT Video @ 400kbits/sec

  7. RTVideo Codec System-level enhancement for error recovery Error recovery Packet loss detection RTP/RTCP RTP/RTCP SMPTE VC-1 decoder SMPTE VC-1 encoder Optimized for Real Time communication RTP: Real Time Protocol RTCP: Real Time Control Protocol SMPTE: Society of Motion Picture and Television Engineers

  8. Emergence Of An RTC Audio/Video Device Market RTC software platform RTC Audio/Video (A/V) devices Quality Performance Functionality Quality Performance Functionality

  9. An OpportunityTo Work Together • A new class of AV devices • Control and signaling capability: Ringing, DTMF, CID,… • Signals are processed digitally • For IP networks • No corresponding WHQL class today • Let’s work together on a set of quality guidelines to optimize the RTC experience

  10. Initial Set Of Guidelines Audio Speaker playbackvolume Frequency range Speaker tomicrophone isolation Passband ripple Microphonesensitivity Channel un-balance In-built microphonespeaker separation SNR Amplitude linearity Total harmonicdistortion

  11. Initial Set Of GuidelinesReference dummy ITU-T Rec. P.58 - Head and torso simulator for telephonometry

  12. Initial Set Of Guidelines Video Resolution Relative illumination Frame rate Chromatic aberration Color formats SNR Light sensitivity Field of view Depth of field

  13. More Parameters Needed? An example With the introduction of the USB Video Class Driver , a number of camera parameters were added to the KSPROPERTY_VIDCAP_CAMERACONTROL enumeration The DirectShow IAMCameraControl interface provides access to these properties SCANMODE PRIVACY PANTILT PAN_RELATIVE TILT_RELATIVE ROLL_RELATIVE ZOOM_RELATIVE EXPOSURE_RELATIVE IRIS_RELATIVE FOCUS_RELATIVE PANTILT_RELATIVE FOCAL_LENGTH

  14. Towards Greater Integration Built-in microphone array Built-in speakers Built-in camera

  15. Headset System Used With Windows Live Messenger Juan ZualagaPlantronics Inc.

  16. Bluetooth Multipoint Headset Demo Once paired, headset connects to PC. Calls on PC can be answered via headset A B … AND also connectsto mobile automatically when in range. Calls on mobile can be answered via headset Two virtual ports A and B available One headset for both

  17. Mobile phone and desk phone in the office Bluetooth Multipoint Headset Demo 1 headset, 3 phones… PC and Mobile Phone 1 headset, 3 phones….

  18. VGA Camera Used With Office Communicator 2007 Philippe DepallensVice PresidentVideo EngineeringLogitech

  19. Logitech® Camera Technologies • Seamless integration of hardware and software • Key camera technologies • RightLight™:RightLight™ is a combination of intelligent hardware and software designed toprovide users with the best image qualityregardless of environment • RightSound™:RightSound™ is a series of software algorithm that eliminates echo and maximizes audio performance • Video Effects™:Making Internet communicationmore fun

  20. Logitech® Presents • QuickCam® Pro 5000 • VGA video with RightLight™ Technology for outstanding low light performance • Hear clear, echo free audio with RightSound™ technology • Wide field of view lens lets more people join in the conversation • Premium USB Headset 350 • Superior clarity with the simplicity of a single USB plug-and-play connection • In-line volume and mute control soft-touch surface allows for precise control • Noise canceling microphone filters out unwanted background noise and folds out of sight when not in use

  21. Future Work Items • Determine whether initial set of parameters needs to be expanded • Define test conditions and meansto verify the guidelines • Consider the possibility to establisha new class of Windows HardwareQuality Labs (WHQL) devices forReal Time Communications

  22. Call To Action • Participate in the review of the initial set of AV device guidelines • Provide feedback on possible extensions of the parameter set • New measurements for higher levelsof interoperability • New functionality (signaling, control) • Participate in the establishment of the testing conditions • Let’s make it happen!

  23. Additional Resources • Web resources • Spec: Audio/Video Device Requirementsand Recommendations – April 2006 • Other resources • http://www.microsoft.com/office/uc • http://www.microsoft.com/office/preview • http://messenger.msn.com/Xp • Related sessions • Audio Considerations for Windows VistaSystem Logo Certification • Email address: av4rtc @ microsoft.com

  24. © 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

More Related