1 / 14

A.G. Malamos Multimedia Lab Dept. of Informatics Engineering

RESTful APIs and Delivery Formats for 3D Resources Kristian Sons (DFKI ) Rémi Arnauld ( AMD) Johannes Behr ( Fraunhofer IGD ) The multimedia point of view. A.G. Malamos Multimedia Lab Dept. of Informatics Engineering TEI of Crete, Heraklion , Crete, Greece (amalamos@ie.teicrete.gr).

sonel
Download Presentation

A.G. Malamos Multimedia Lab Dept. of Informatics Engineering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. RESTful APIs and Delivery Formats for 3D ResourcesKristian Sons (DFKI) RémiArnauld (AMD)Johannes Behr (Fraunhofer IGD)The multimedia point of view A.G. Malamos Multimedia Lab Dept. of Informatics Engineering TEI of Crete, Heraklion, Crete, Greece (amalamos@ie.teicrete.gr) 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  2. The multimedia dimension of graphics Graphics and especially virtual worlds have a clear multimedia dimension in the sense of coexistence of multiple medias presented together in real time to provide an integrated audiovisual result. Performance in that case is a convolutional result of several factors applied to graphics, video and image textures and sound. Such performance factors might be...LOD (resolution), Delay, Jitter and of course.... user expectations. 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  3. Our experiments in real-time 3D delivery HTTP vsWebsockets (The two most popular approaches on application networking) The MPEG DASH (Dynamic Adaptive Streaming over HTTP) 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  4. HTTP vsWebsockets The 1st experiment 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  5. HTTP vsWebsockets (1/5) What is websockets? WebSocket is a protocol providing full-duplex communications over a single TCP connection. The WebSocket protocol was standardized by the IETF as RFC 6455 in 2011, and the WebSocket API is being standardized by the W3C. Client Server Handshake (upgrade HTTP) Time Full-duplex Data Channel Persistent Connection 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  6. HTTP vsWebsockets(2/5) The websocketstestbed TCP/IP WEBSOCKETS HTTP STOMP Simple (or Streaming) Text Orientated Messaging Protocol 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  7. HTTP vsWebsockets (3/5) The data-set We have currently uploaded several models from tens of thousands to millions of point coordinates, including colour, faces and normals information The dome of the church of St. Ioannis in the TEI area, in Crete Traditional Cretan musical instrument Ancient Theater Demetriados An olive tree Egyptian Cat from the The Classic Archaeology Collection in the Museum of Archeology and History of Art of the University of Athens an amphora a wheel-made plate Corinthian oinochoe a wheel-made lekythos) 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  8. HTTP vsWebsockets(4/5) • Models are in X3D-X3DOMformat • Three Web-based distribution platforms available to compare: • Direct display • progressive streaming over HTTP requests • Websocket-STOMP progressive transmission • Optional use of LZW compression into streams • Two progression modes: • Serial (neighborhood) progression • Area sort (biggest triangles first) 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  9. HTTP vsWebsockets(5/5) a. Serial progression b. Area sort progression • Webservices have better performance than HTTP requests • Entropy Compression (LZW) increase performance in Webservices and it degrades performance of http requests • Streaming has better performance than model downloading 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  10. MPEG DASH in real-time graphics delivery? The 2nd experiment 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  11. MPEG DASH (1/4) Source: MPEG DASH IF The MPEG-DASH streaming adaptation approach is conceptually simple. A client (player) application accesses the Media Presentation structure of a media, normally stored in an XML file with the extension .mpd, and selects the appropriate Adaptation Sets corresponding to the characteristics of the end-device and the end-user (e.g. audio tracks in specific languages, video tracks in specific encodings). Then, the client begins downloading and playing Representations from these adaptation sets, while at the same time probing for QoE metrics (e.g. achieved FPS rate, remaining power, computational resources available). 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  12. MPD Structure Representation #1 Multimedia Presentation Description Representation #2 Representation #3 … X3D VR World Mesh parameters 3D Model Stream preparation Texture Image/Video MPEG DASH 2/4 The media (3D) file preparation 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  13. Host Server2 Host Server1 Host Server(n) Web Server Network Presentation Quality (LOD) Decision Memory Metrics Probing Battery X3DOMDisplay Client FPS Timer MPEG DASH 3/4 The MPEG DASH player 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA

  14. MPEG DASH 4/4 The test-bed and results 19TH INTERNATIONAL CONFERENCE ON 3D WEB TECHNOLOGY AUGUST 8-10 – VANCOUVER, CANADA http://mclab1.medialab.teicrete.gr:8081/indexdash.html

More Related