Networked Audiovisual Systems and Home Platforms Augusto.Dealbuquerque@cec.eut INFSO D2

1. Information Society Technologies 6th Framework Programme Networked Audiovisual SystemsandHome PlatformsAugusto.Dealbuquerque@cec.eu.intINFSO D2 Presentation to the NCPs January.2002

2. INFSO D2 in a nutshell Overview topics on audio-visual systems and home platforms From FP5 to FP6 : technical challenges and objectives in FP6

3. INFSO D2 in a nutshell The Unit D2 will support the innovation and development of technologies for end-to-end interoperable audio-visual networks, services and applications. Key R&D aspects address innovation in the processing and delivery of audio-visual materials, cross media platforms and devices, including broadcast, home platforms and new visual systems and devices (3D displays).

4. INFSO D2 in a nutshell Head of Unit: Augusto de Albuquerque 9 Project Officers 6 Administration Team 5 Secretaries Fiona Whiteman Fiona Allan Eric Badique Sirpa Ahomaa Remy Bayou Paolo Boeri Nadia Guillaume Emiel de Hert Pierre Edelsztein Marie Rochat Georgia Efthymiopoulou Anne-Catherine Gilson Maria Tjader Carlos Morais-Pires Adelaide Saafi Kostas Papanikolaou Virginie Sold Jorge Santos Leon Van Noorden (HoS) Thierry Devars

5. INFSO D2 in a nutshell Mid-term to longer-term research: they will prepare the next steps Support standardisation Awareness of ongoing work on regulation of digital AV networks and services Key criteria Vision from information to experience Industrial strength in phase with Europe's strongest industrial assets Need for intervention at EU level focus on synergy between innovation and Industrial exploitation (standardisation has a key role) Expected impact next wave of innovation in Audio-Visual systems

6. Policy drivers Innovation in R&D to allow wise investors to make wise decisions and contribute to Audiovisual/Information Society markets to development Support to European standards for interoperability and affordability to make a success of eEurope 2005 objectives, in particular for DTV platforms ‘Internet services must be accessible through mobile and TV’, Liikanen, le Figaro, 04/11/02 3G and DTV are key component to widen the broadband access to Information Society Services. (Commission communication on “Barriers to widespread access to new services and applications of the information society through open platforms in digital television and third generation mobile communications”)

8. SO: Networked Audiovisual Systems and Home Platforms Trusted free choice environments for more intuitive access and interaction with hybrid 3D multimedia signals and objects. Rich media objects representation, identification, location and description Seamlessly co-operating IP (Internet Protocol) audiovisual (AV) networks, storage, new middleware protocols and architectures for real time and consistent multimedia routing, storing and distribution, load and balancing control mechanisms, P2P, datacasting and streaming of audio-visual rich media. Adaptive Quality of Services for scalable audio-visual flows on heterogeneous networks, AV internetworking, network traffic engineering, interactive AV service management, and simulation.

9. SO: Networked Audiovisual Systems and Home Platforms Home server portals, interoperability between home networking technologies and their integration with global networks, as a means for access to, and generation of combined applications and services. AV portals with storage, management and repackaging appliances, including extended home distribution. Advanced retrieval methods and business models to support access to streamed and stored audiovisual media from anywhere in the home and car environment from any device. Research will strongly concentrate on enabling technology for error-resilient representation, slicing and handling of rich audio-visual signals.

10. SO: Networked Audiovisual Systems and Home Platforms It concerns basic research, structuring and federating the best groups in Europe from the communication areas. It also concerns research in high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services. A strong requirement will be that these activities should be centred around a communication and storage infrastructure and should aim at exploiting the outstanding European potential developed over several Programmes in this area. Active contribution to world-wide standard setting will be a prerequisite.

11. INFSO D2 scope:essential elements of convergence… Elements in Convergence Activators Rich Media Motion picture Music, Sound, Voice Still image, Graphics, Text Digitalization TV, Telephone, Internet Interactive/Passive E-mail, E-commerce (transactional) Information Streamed in Real-Time/Cached Personalized/General Public Service Advances in Technology Transport Analog & Digital Broadcasting Networks (Terrestrial/Satellite/Cable) Telecom Networks (Fixed-line/Mobile) Dedicated Networks Affordability of Technology Terminal TV, PC, PDA Fixed-line phone Mobile phone Glasses, Watches USERS

12. … structuring the area in IST in FP6 RICH MEDIA TECHNOLOGIES SERVICE / APPLICATIONS Virtual presence e-learning, games, VoD Virtual and Mixed Reality Complex AV Scenes Coding, Graphics Interactive TV 2D and 3D audio/video Rich AudioVisual Services Terminal APIs Advanced Rendering and Visualization Server, set top box, broadband access Digital Rights Management Home Networked Appliaces network QOS, streaming MPEGx enabled Players DVB-Networks CATV Home networks IP Multicasting AV NETWORKING BROADBANDTERMINAL/ SERVER

13. Audiovisual Flow in a Broadband World Content Producers Distributors Broadcasters Service Providers Broadband Internet IP-Network Operators trad. Dig. TV MPEG2-Network Operators Consumers Networked Homes

14. Transport Networks INFO and INFRA structures INFO-STRUCTURE End-user Rich AV Services Logical, Terminal: STB,TV,PC, handset, mobile AV Rich Media Objects Broadband Access and Home networks Physical INFRA-STRUCTURE

15. IST/FP6: … challenges

16. Home Network(s) and Platforms The Home Network plays an important role it is the “consumer domain” where she/he and family will use multiple interconnected devices (displays, storage digital warehouses, e-paper) this network will have one or more broadband access gateways to the global networks it is possible that the predominant home network infrastructure will be wireless it is also an important domain of consumer privacy and citizen security

17. Digital Home Platform: broadband to the home(from of the VRT/Belgacom trial) DVB-T Broadcaster Service Provider New ways of programming Home Network enriched content Cable/TV Gateway Broadband Access Telecom Operator Interactive services and content

18. Internet Multicast delivery IP Streaming: Internet, Telco and Broadcasting... • Audiovisual Content is the key driver: video needs QoS and broadband networking management • Open standards (content format, security, ...) • Co-operative infrastructures... xDSL, ... etc.

19. Advanced Rendering & Visualisation Research aimed at overcoming current technological and usability constraints in 3D visualisation for 3DTV emerging markets. Target Areas: Autostereoscopic Displays: Multi-viewer, unconstrained Volumetric or Holographic based Displays Advanced Image Processing: Image Acquisition, Processing, Synthesis, Rendering

20. Rich Media Technologies Representation and manipulation of rich AV media Signal processing, coding, computer graphics and vision Applied research in high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services... Activities should be centred around a communication infrastructure

21. Networked AV Systems and Services • “low cost access network equipment,…optimized as function of the operation environment, including …interactive broadcasting. • new concepts for network management,…to provide enhanced intelligence and functionality in the access network for delivery of new services, and end-to-end network connectivity. • multi-service capability: (i.e. e.g. for cable operators: VoIP, fast internet access, multi-site games, video-communication). • Increase bandwidth capacity,…commensurate with the expected evolution in user requirements … (depends on services, coding …) • a generalized introduction of BB services (..scalability..) • …the access portion of the next generation network.. • …regulatory aspects...

22. Reserve Slides

23. Regulating Digital TV… challenges of convergence our collaboration with Policy/Regulation Authorisation Directive Access & Interconnection Directive Unbundled local loop Regulation Users’ Rights Directive Data Protection Directive Framework Directive (Art. 95) Liberalisation Directive (Art. 86) Spectrum Decision (Art. 95)

24. DVB-S & DVB –C world adoptionDVB-T Near world Standard Satellite & Cable Standards predominantly DVB or slight variants Satellite & Cable Standards all DVB Japan mostly DVB but recent introduction of ISDB S • DVB –T essential for receiver Interoperability, Portability, Mobility • Common receivers for Satellite /Cable /Terrestrial • Benefits for Consumer & Broadcaster

25. iTV standards adoption with TV operators MHP MHP + ATSC DASE on terrestrial MHP + ISDB BML Undecided

26. Market Trends for Advanced AV Services

27. Set Top Box Market potential … + content & service revenues + cross-platform revenues... Large market potential - but need attractive content & services Strategic market for Europe... if the opportunity is taken

28. Digital TV Household forecast

29. Flat Display Market