340 likes | 612 Views
Introduction to the Stereoscopic Player. 3D Korea International Film Festival November 19th, 2011 Gwangju, South Korea. Overview. Stereoscopic Player Concept Input settings Output settings Supported formats Features Other 3dtv.at applications Stereoscopic Multiplexer
E N D
Introduction to theStereoscopic Player 3D Korea International Film Festival November 19th, 2011 Gwangju, South Korea
Overview • Stereoscopic Player • Concept • Input settings • Output settings • Supported formats • Features • Other 3dtv.at applications • Stereoscopic Multiplexer • MVC to AVI Converter Peter Wimmer - 3dtv.at
Focus Stereoscopic video playback Stereoscopic video recording Products Stereoscopic Player Stereoscopic Multiplexer MVC to AVI Converter Location Linz, Austria www.3dtv.at Timeline Development started 2001 Completed diploma thesis in June 2004 Company founded in 2005 About 3dtv.at Peter Wimmer - 3dtv.at
Stereoscopic Player • The Stereoscopic Player is a 3D video playback application for stereoscopic and multi-view videos on the Windows platform Peter Wimmer - 3dtv.at
3D Video Playback ? • The questions • Why do we need 3D playback software? • Why not use any 2D video player? • The challenges • Many 3D display technologies • Many 3D formats • The solution • Real-time format conversion • 3D playback software ! Peter Wimmer - 3dtv.at
Real-Time Format Conversion L R • Real-time format conversion … • … avoids vast number of files • … requires full color left and right views • … gives best quality • Suitable source formats Interlaced (Field Sequential) L L R R Side-by-Side Over/Under Dual Files/Stream Peter Wimmer - 3dtv.at
Dual Files, Dual Streams • Dual files • Efficient use of multi processor systems • Circumvent codec limitations (often limited to 1920 x 1080) • Playback synchronization is prone to errors • Performance problems when located on same media • Dual streams • Avoid performance problem of separate files • 2D video players show the left video stream only • Supported for Windows Media, MP4 and AVI formats • Multi View Coding (MVC) removes redundancy Peter Wimmer - 3dtv.at
Stereoscopic Player Menues • Input settings • Stored per file • Different for each file • Output settings • Stored globally • Configured once Peter Wimmer - 3dtv.at
Format Selection • Stereoscopic Player asks the user to select the format when opening a new video • Stereoscopic Player remembers settings for each file in the built-in video library Peter Wimmer - 3dtv.at
Stereoscopic Metadata • Fundamental idea • It is hard for users to find out the proper layout • The content creator knows the proper layout • Ship video files + format description (= metadata) • Stereoscopic Player … • … reads embedded metadata in Windows Media files • … reads metadata file in same folder as the video file • … contacts metadata server (turned off by default) • The official metadata server is maintained by 3dtv.at and provides settings for most commercial 3D-DVDs and some popular video files. Peter Wimmer - 3dtv.at
Creating Stereoscopic Metadata • Use the Windows Media Stereo Attribute Editor to embed metadata in Windows Media files (available for download on the 3dtv.at website) • Click File|Export in Stereoscopic Player to create a separate metadata file (for all other formats than Windows Media) Improve user experience – deliver your movies with metadata! Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods Anaglyphs Native support Any graphics card, any display Shutter glasses NVIDIA 3D Vision / Quad Buffered OpenGL Software Pageflipping (ATI and Intel) Polarized projection Dual Screen OutputQuad Buffered OpenGL Peter Wimmer - 3dtv.at
Native Dual Screen Output 1. 2. Peter Wimmer - 3dtv.at
Dual Screen Output via OpenGL • Requires professional graphics card (Quadro FX, FireGL) • Graphics driver set to clone mode • Normal 2D operation possible Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods HDMI 1.4 frame packing format Via NVIDIA 3D Vision driver Only 24 Hz at 1920 x 1080 Squeezed side-by-side format View|Aspect Ratio|Half Width TVs accept up to 60 Hz Squeezed over/under format View|Aspect Ratio|Half HeightIdeal for polarized TVs Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods 3D-DLP-TVs Checkerboard pattern natively support Viewed with shutter glasses LCD displays with micro-polarizer Interlaced pattern natively supported Viewed with circular polarized glasses Peter Wimmer - 3dtv.at
Autostereoscopic Displays • Do not require glasses • Two basic technologies • Lenticular lenses in front of the LCD panel • Parallax barrier behind the LCD panel • Lenticular add-on lenses possible Peter Wimmer - 3dtv.at
Types of Autostereoscopic Displays • Narrow viewing angle • Only left and right view required • Wider viewing angle • More than two views needed • Image acquisition difficult • Interpolation of images planned for future player version Multi Viewer Single Viewer Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods • Autostereoscopic single-viewer • Column Interlaced • Tridelity SL Series 3D Display • Sharp 3D Displays • Generic Single-Viewer Display • Autostereoscopic multi-viewer • Tridelity MV Series Multi-Viewer Display • Generic Multi-Viewer Display More displays are added on request but are already supported by the generic viewing methods Peter Wimmer - 3dtv.at
Stereoscopic Player Viewing Methods Peter Wimmer - 3dtv.at
General features File playback 3D-DVD playback Capture device support Intuitive user interface IR remote control support Integration features Command line control OLE Automation Serial Sony 9-pin protocol Windows Media features Streaming Digital Rights Management Multi-channel audio Multiple audio languages Professional features Customization tool Effect control (COM, UDP, DMX512) Stereoscopic Player Features Peter Wimmer - 3dtv.at
Supported File Formats • Video formats • Video for Windows (*.avi) • Windows Media (*.wmv) • Quicktime (*.mov) • MPEG-1, MPEG-2 (*.mpg) • Material Exchange Format (*.mxf) • Third party DirectShow decoders allow playback of additional format • Image formats • Windows Bitmap (*.bmp) • JPEG (*.jpg, *.jps, *.mpo) • GIF (*.gif), TIFF (*.tif), PNG (*.png) AVI MPG Peter Wimmer - 3dtv.at
3D Blu-ray Playback • Stereoscopic Player plays *.ssif files • No menu navigation yet (but planned) • Third party decryption tool required • Install AnyDVD HD • Click File|Open File • Go to the BDMV\ STREAM\SSIF folder • Select largest file Peter Wimmer - 3dtv.at
MVC Playback • H.264 Multi View Coding (MVC) is the 3D video format of the future • MVC is used by 3D Blu-ray disks and the latest 3D camcorders • Player supports the MVC codec in *.mts (Sony) and *.mp4 (JVC) files Peter Wimmer - 3dtv.at
H.264 Multi View Coding • MVC is an extension of the proven H.264/AVC industry standard • Saves approximately 50% of the right view's data rate • Exploits the correlations between the left and right views Peter Wimmer - 3dtv.at
Effect Control • Control curtains, motion seats, lights, fog, water spray, … • Supports COM, UDP and DMX512 output • Effect data are stored in XML files with *.effx extension Peter Wimmer - 3dtv.at
Effect Control File Example <?xml version="1.0" encoding="UTF-8" ?> <EffectStream> <BytesSamples> <BytesSample sampleTime="00:00:00.000" text="First command" /> <BytesSample sampleTime="00:00:01.000" text="Second command" /> <BytesSample sampleTime="00:00:02.000" text="Third command" /> </BytesSamples> <DmxChannels> <DmxChannel slotNumber="1" slotCount= "2" name="Sample Channel" /> </DmxChannels> <DmxSamples> <DmxSample sampleTime="00:00:00.000" channelIndex="1" value="x0102" /> <DmxSample sampleTime="00:00:01.000" channelIndex="1" value="x0304" /> <DmxSample sampleTime="00:00:02.000" channelIndex="1" value="x0506" /> </DmxSamples> </EffectStream> Peter Wimmer - 3dtv.at
Stereoscopic Multiplexer Concept R L R L Right stream Left stream Combined video stream Peter Wimmer - 3dtv.at
Fields of Applications • Live preview during recording • Stereoscopic Multiplexer loaded in Stereoscopic Player • Live broadcasts • Stereoscopic Multiplexer selected as capture device in Windows Media Encoder, running on the server • Stereoscopic Player running on the client • Watching 3D recording • Transferring left and right tape to hard disk not required • Stereoscopic Multiplexer synchronizes tape drives Peter Wimmer - 3dtv.at
Supported Hardware • Camcorders • DV camcorders • HDV camcorders (next version) • Digital cameras • Industrial Firewire cameras • Industrial USB cameras • Webcams • Others • Analog cameras via frame grabbers • Many other WDM-compatible capture devices Peter Wimmer - 3dtv.at
MVC to AVI Converter • Batch converter for MP4 (JVC) and MTS (Sony) MVC files Peter Wimmer - 3dtv.at
Q&A Thanks for Your Attention Visit us at http://www.3dtv.at! Peter Wimmer - 3dtv.at