1 / 32

Research on Key Technology in Grid Delivery Network

Research on Key Technology in Grid Delivery Network. Zhihui Lv Network & Information Engineer Center of Fudan university, ShangHai, China 2003.8.28. Host Server. Sprint. UUnet. Gloobix. QWest. Clients. 1.Content Delivery Network (CDN). Slow Response. Huge Requests. @Home. Clients.

felipec
Download Presentation

Research on Key Technology in Grid Delivery Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Research on Key Technology in Grid Delivery Network Zhihui Lv Network & Information Engineer Center of Fudan university, ShangHai, China 2003.8.28

  2. Host Server Sprint UUnet Gloobix QWest Clients 1.Content Delivery Network (CDN) Slow Response Huge Requests @Home Clients PSINet Server Crash MindSpring Clients Niec, Fudan University, ShangHai, China

  3. 1.Content Delivery Problems Niec, Fudan University, ShangHai, China

  4. Host Server QWest 1.(1)Use Client Cache/Client Side Cache Server Fewer Requests Clients @Home PSINet Fast Response Sprint UUnet Client Cache Gloobix MindSpring Client Side Cache Server Clients Clients Niec, Fudan University, ShangHai, China

  5. Fewer Requests Host Server UUnet Sprint Server Gloobix QWest MirrorSite 1.(2)Use Mirror Sites Need improvement by guiding the selection of mirror servers with server load/network bandwidth measurement Mirror Site Clients @Home PSINet Clients MindSpring Fast Response Clients Niec, Fudan University, ShangHai, China

  6. Cache Server Cache Server Cache Server Cache Server Fewer Requests Host Server Sprint UUnet Server Gloobix QWest MirrorSite Mirror Site 1.(3)Edge Network Cache Servers Fast Response Clients @Home PSINet Client Cache MindSpring Edge Network Cache Server Client Side Cache Server Clients Clients Niec, Fudan University, ShangHai, China

  7. 1.Akamai CDN Solution --Edge Delivery Service Niec, Fudan University, ShangHai, China

  8. 2.Drawback of CDN • Cache Location Problem: Where to put cache servers? • How many are needed? • When/where/how to push/delivery the content? • How about dynamic content? Niec, Fudan University, ShangHai, China

  9. 2.Drawback of CDN • Although CDN is an effective means of multimedia information access and delivery, there are several barriers to making CDN a more common service: • Big cost • Bad scalability • Complicated replication integrity. Niec, Fudan University, ShangHai, China

  10. 3. Emergence of Grid Delivery • The combination of the grid technology and CDN technology has produced a novel technology——grid delivery. • Grid delivery is an emerging technology that enables the distribution of rich media throughout a bandwidth-constrained network. Niec, Fudan University, ShangHai, China

  11. HP IBM WebSphere Microsoft.Net Sun ONE 3. Emergence of Grid Delivery GGG（Great Global Grid） Information and Knowledge Grid Computing and Data Grid Other Grid Models Business Grid CDN RTEC Real-Time Enterprise Computing Web Service Semantic Web Knowledge Management Ontology Information Platform TeraGrid IPG GIG ASCI Grid Data Grid P2P Parasitic Computing Niec, Fudan University, ShangHai, China

  12. 3. Emergence of Grid Delivery • Grid delivery promises to be a viable solution for distributing on-demand streaming content and other large files directly to end-user systems. • Grid delivery has its origins in the world of Internet-based content delivery. The objective of grid delivery is to create a network of systems for enabling content delivery to a single recipient. Niec, Fudan University, ShangHai, China

  13. XML Web Services Connector Network Publisher Network Protector Network Manager Network Analyzer(name might change) Grid Delivery Technology Grid Delivery Server Grid Delivery Server 4. Infrastructure of Grid Delivery Niec, Fudan University, ShangHai, China

  14. XML Web Services Connector Network Publisher Network Protector Network Analyzer(name might change) Network Manager Grid Delivery Technology Grid Delivery Server Grid Delivery Server 4. Infrastructure of Grid DeliveryGrid Delivery Technology creates a network of shared resources where any PC or server can deliver content on demand. • Bandwidth Harvesting • XML Delivery Security • Dynamic Optimization • Grid Delivery Servers • Delivery Managers Niec, Fudan University, ShangHai, China

  15. Time Shifted Delivery Peak Smoothing via Scheduling and Bandwidth Rate Limiting 100% 100% 0% 0% 5.Grid Delivery Technology • 5.1Time Shifted Delivery Time Shifted Delivery Niec, Fudan University, ShangHai, China

  16. Adaptive Rate Multiserving Model Typical Serving Model Origin Server1 Origin Server2 Origin Server3 Origin Server User User 5.Grid Delivery Technology • 5.2 Adaptive Rate Multiserving (ARM) Adaptive Rate Multiserving (ARM) Niec, Fudan University, ShangHai, China

  17. 5.Grid Delivery Technology • 5.3 Outer Edge Caching Niec, Fudan University, ShangHai, China

  18. 5.Grid Delivery Technology • 5.3 Outer Edge Caching Niec, Fudan University, ShangHai, China

  19. 5.Grid Delivery Technology • 5.3 Outer Edge Caching Niec, Fudan University, ShangHai, China

  20. 5.Grid Delivery Technology A secure, managed delivery system must satisfy the following security requirements : • 5.4 XML Delivery Security • (1)Access Control - The delivery system must provide an access control mechanism that controls access to the content in the network and also provides controls over who is authorized to publish content to the network. This system must work with an enterprise's existing security infrastructure and be integrated with a central directory system to facilitate administration and maintenance of users and groups. • (2)Network Security - The delivery system must ensure that files are not delivered to unauthorized users, and that attackers cannot infiltrate the system itself. Niec, Fudan University, ShangHai, China

  21. 5.Grid Delivery Technology A secure, managed delivery system must satisfy the following security requirements : • 5.4 XML Delivery Security (3)Desktop Security - The delivery system must provide a level of control over content use and redistribution that is appropriate to the nature of the content and the identity of the intended recipient. (4)Enterprise-Ready Standards and Support - The delivery system must support all enterprise standards and be easily deployable within an enterprise. The system must also offer a high level of reliability and scalability to handle large numbers of users across geographic boundaries and network topologies. Niec, Fudan University, ShangHai, China

  22. 5.Grid Delivery Technology • 5.4 XML Delivery Security XML Delivery Security Infrastructure Niec, Fudan University, ShangHai, China

  23. 5.Grid Delivery Technology • The security measures in this infrastructure are as following: • （1）Access Control: • nUser Authentication and Authorization; • n Secure Publishing; • nContent Access Rules; • n Enterprise Security Infrastructure Integration; • n Centralized Deployment and Administrator. • 5.4 XML Delivery Security Niec, Fudan University, ShangHai, China

  24. 5.Grid Delivery Technology • The security measures in this infrastructure are as following: • （2）Network Security: • nStrong Encryption; • n XML-based Secure Distributed Delivery Protocol; • nPoint-to-Point Security; • nUnique Private Keys; • nSecured Node; • nContent Integrity. • 5.4 XML Delivery Security Niec, Fudan University, ShangHai, China

  25. 5.Grid Delivery Technology • The security measures in this infrastructure are as following: • （3）Desktop Security and Usage Control: • nCopy and Re-Distribution Prevention; • n Encrypted File Controls;nPoint-to-Point Security; • nThe 3rd Party Digital Rights Management Support. • 5.4 XML Delivery Security Niec, Fudan University, ShangHai, China

  26. 6.Delivery Grid dramatically increases performance while efficiently utilizing centralized bandwidth Delivery Performance Use of Internet or WAN Bandwidth Central Server Load Central Server100% Grid Server 30% Central server bandwidth load reduced by 30% 15x times faster than central server Testing Notes: • Central Server bandwidth speed is 0.47 Mbps or approx. 1/3 use of a dedicated T1 • Delivery speed calculated by ratio of file size to time of delivery for 20MB file • Load % is ratio of average bytes delivered by Central Server to average bytes delivered by Grid Server. Niec, Fudan University, ShangHai, China

  27. 6.Average Time to Deliver 20MB file Grid over 15x times faster than central server - Central Server bandwidth speed is 0.47 Mbps or 1/3 of T1 speed (1.4Mbps) Niec, Fudan University, ShangHai, China

  28. 7. The Challenges and Future Prospect (1)Rich media grid delivery is a novel model for content delivery initially focused on the needs of the enterprise. It is a flexible system that utilizes the network and computing resources already present in the enterprise much more efficiently, extremely important in this age of tight IT budgets and staffing. But the challenge is how to apply Grid Delivery to Internet scale. Niec, Fudan University, ShangHai, China

  29. 7. The Challenges and Future Prospect (2) As content becomes more digital, locating and managing the most atomic elements of that content for potentially millions of simultaneous users will be an exponentially difficult challenge to address. Structured content such as XML-defined contexts combined with a strict adherence to the practices associated with many commercial content management systems will help alleviate some of this burden. But the sheer volume and diversity of digital content types—text, image, audio, and video, each with their own variety of file formats—will demand a more flexible solution with massive computational capacity. This is one of the problems that Grid Delivery had to solve in the recent future. Niec, Fudan University, ShangHai, China

  30. 7. The Challenges and Future Prospect (3) Grid Delivery promises to be a viable solution for distributing on-demand streaming content and other large files directly to end-user systems. Broadcasting live, concurrent, real-time streams using a grid delivery network is possible, but has not yet proven to be scalable. Therefore, researching and developing real-time grid streaming delivery technology is a great challenge. (4) Grid Delivery technologies offer an advantage for storing and retrieving large datasets efficiently, but that it remains a question whether the Grid is beneficial for storing and managing large numbers of files that vary greatly in size. Niec, Fudan University, ShangHai, China

  31. 7. The Challenges and Future Prospect (5) the next Globus Toolkit upgrade (3.0)—to be rolled out over the course of 2003—will incorporate Open Grid Services Architecture (OGSA), providing standardized discovery, management, and monitoring facilities for coordinating multiple Web services and provisioning their associated resources. While Globus Toolkit 3 marks a milestone, there is still a long way to go before the ability to access distributed computation and resource is as straightforward as access to the Web. Niec, Fudan University, ShangHai, China

  32. Thank You For Your Question!!! Niec, Fudan University, ShangHai, China

More Related