140 likes | 344 Views
VIRTUE – VIRtual Team User Environments Oliver Schreer Heinrich-Hertz-Institute , Berlin Germany. Outline. The challenge of VIRTUE The VIRTUE station The VIRTUE architecture The developed hardware Conclusion. The challenge of VIRTUE. Remote Conferees
E N D
VIRTUE – VIRtual Team User EnvironmentsOliver SchreerHeinrich-Hertz-Institute, Berlin Germany
Outline • The challenge of VIRTUE • The VIRTUE station • The VIRTUE architecture • The developed hardware • Conclusion
The challenge of VIRTUE • Remote Conferees • represented by full-body sized 3D video images • as natural as possible (no avatars please !!) • Conference Situation • exact reproduction of eye contact, gaze, gestures and body language • realistic viewing conditions by support of head motion parallax • Local Conferees • sitting in front of large immersive mono- or stereoscopic displays • such that they feel immersed in shared virtual environment
The VIRTUE terminal one year ago Current State of the VIRTUE Station(e.g.: 50’’ plasma display) Terminal Design(e.g.: 80’’ rear projection)
Metal framework for mounting cameras and speakers 4 Pulnix Colour Progressive Scan Cameras 61” Plasma display Audio Speakers Access to 3 compartments at the rear of the terminal for PCs and other hardware Semi-circular table The current state
VIRTUE – 2D Demonstrator at IST Event 2001 See video clips at http://bs.hhi.de/SPAG/SPAG-IST_Event2001.htm
4 x 32 Mbyte SDRAM TriMedia TM1300, 143 MHz 4 x VideoIn/VideoOutCCIR601/656 compliantconnecting the interface board Connection to PCI of host PCvia PCI bridge VPS Board (Virtue Processor Station) Internal PCI busconnecting all TriMedia’s
Router FPGA for flexible VideoIn/VideoOut connections 4 x SDI In 4 x SDI Out 4 x LVDS In/Out 4 x VideoIn/VideoOutCCIR601/656 compliantconnecting the VPS board SDI/LVDS Interface (SMPTE 259M)
Using Multimedia and SIMD capabilities of the TriMedia Arbitrary VideoIn/VideoOut with interface board Flexible: C++ code can be used, modified and upgraded directly Modular: Multiple boards can be plugged in 32 bit/64 bit slots Based on standard PCI technology Complete VPS package
The MPEG-2 Low Delay Coder • MPEG-2 Encoder: • 4:2:0 transport stream • Encoding latency < 80ms • Image size 640x480/25 fps • Bitrate 2 Mbit/s • MPEG-2 Decoder: • Decoding latency < 80ms • VIRTUE camera link output • MPEG-2 PCI Base Board: • 66 MHz/64 Bit universal PCI card • 4 MPEG-2 Encoder modules • 4 MPEG-2 Decoder modules • VIRTUE camera link output
Conclusions and Outlook • Real-time hardware fullfilling the demands • Video streaming without loading the host PCI bus • Completely PCI based • Flexible in terms of software update, modification and extension • Successful 2D demonstrator presented at IST event 2001 • Complete 3D video conferencing system in September 2002 • MPEG2 encoding, transmission, 3D analysis, view synthesis, rendering, audio, document sharing • Final human factors test in October 2002
Announcement Workshop on „Immersive Communication and Broadcast Systems“ 29.-30. January 2003 Heinrich-Hertz-Institut (HHI), Berlin, Germany http://bs.hhi.de/ICOB-Workshop Kontakt: Oliver Schreer, schreer@hhi.de