1 / 17

The EU DataTAG Project

The EU DataTAG Project focuses on Grid network research and interoperability between European and US Grids, with a 2.5 Gbps transatlantic lambda connection. The project aims to enhance Wide Area Networking transparency and improve collaboration between GRID projects in Europe and North America. The project includes European partners such as INFN, PPARC, and CERN, with significant contributions from various collaborators. The work plan includes provisioning, high-performance networking, bulk data transfer, application performance monitoring, interoperability between Grid domains, and planning details for future project developments. The project is set to make advancements in network resource reservation, data transfer optimization, and application performance.

mbadger
Download Presentation

The EU DataTAG Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The EU DataTAG Project Presented at the Grid Workshop LISHEP conference 7th February Rio de Janeiro, Brazil Olivier H. Martin CERN - IT Division

  2. The project • Two main focus: • Grid related network research • Interoperability between European and US Grids • 2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago) • dedicated to research (no production traffic) • Expected outcomes: • Hide complexity of Wide Area Networking, i.e. the network becomes truly transparent. • Better interoperability between GRID projects in Europe and North America • DataGrid, possibly other EU funded Grid projects • PPDG, GriPhyN, DTF, iVDGL (USA) The EU DataTAG Project

  3. The project (cont) • European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator. INRIA (FR) & ESA (European Space Agency) will join soon. • Significant contributions to the DataTAG workplan have been made by Jason Leigh (EVL@University of Illinois), Joel Mambretti (Northwestern University), Brian Tierney (LBNL). • Strong collaborations already in place with ANL, Caltech, FNAL, SLAC, University of Michigan, as well as Internet2 and ESnet. • Budget: 3.98 MEUR • Start date: January, 1, 2002 - Duration: 2 years • Funded manpower: ~ 15 persons/year • NSF support through the existing collaborative agreement with CERN (Eurolink award) The EU DataTAG Project

  4. UK SuperJANET4 NL SURFnet GEANT IT GARR-B DataTAG project NewYork Abilene STAR-LIGHT ESNET CERN MREN STAR-TAP

  5. DataTAG planned set up(second half 2002) DataTAGtest equipment CERN PoP Chicago DataTAGtest equipment DataTAGtest equipment STARLIGHT UvA INFN PPARC …... (Qwest NBC PoP) DataTAGtest equipment ESNET GEANT ABILENE 2.5 Gb DataGRID PPDG iVDGL CERN GriPhyN DTF CIXP DataTAG test equipment

  6. Workplan (1) • WP1: Provisioning & Operations (P. Moroni/CERN) • Will be done in cooperation with DANTE • Two major issues: • Procurement • Routing, how can the DataTAG partners have transparent access to the DataTAG circuit across GEANT and their national network? • WP5: Information dissemination and exploitation (CERN) • WP6: Project management (CERN) The EU DataTAG Project

  7. Workplan (2) • WP2: High Performance Networking (Robin Tasker/PPARC) • High performance Transport • tcp/ip performance over large bandwidth*delay networks • Alternative transport solutions • End to end inter-domain QoS • Advance network resource reservation The EU DataTAG Project

  8. Workplan (3) • WP3: Bulk Data Transfer & Application performance monitoring (Cees deLaat/UvA) • Performance validation • End to end user performance • Validation • Monitoring • Optimization • Application performance • Netlogger The EU DataTAG Project

  9. Workplan (4) • WP4: Interoperability between Grid Domains (Antonia Ghiselli/INFN) • GRID resource discovery • Access policies, authorization & security • Identify major problems • Develop inter-Grid mechanisms able to interoperate with domain specific rules • Interworking between domain specific Grid services • Test Applications • Interoperability, performance & scalability issues The EU DataTAG Project

  10. Planning details • The lambda availability is expected in the second half of 2002 • Initially, test systems will be either at CERN or connect via GEANT • GEANT is expected to provide VPNs (or equivalent) for Datagrid and/or access to the GEANT PoPs. • Later, it is hoped that dedicated lambdas for Datagrid will be made available through GEANT or other initiatives (e.g. Flag Telecom) • Initially, a 2.5 Gbps POS link • WDM later, depending on equipment availability The EU DataTAG Project

  11. The STAR LIGHT • Next generation STAR TAP with the following main distinguishing features: • Neutral location (Northwestern University) • 1/10 Gigabit Ethernet based • Multiple local loop providers • Optical switches for advanced experiments • The STAR LIGHT will provide 2*622 Mbps ATM connection to the STAR TAP • Started in July 2001 • Also hosting other advanced networking projects in Chicago & State of Illinois N.B. Most European Internet Exchanges Points have already been implemented along the same lines. The EU DataTAG Project

  12. StarLight Infrastructure • …Soon, Star Light will be an optical switching facility for wavelengths University of Illinois at Chicago

  13. Evolving StarLightOptical Network Connections Asia-Pacific SURFnet, CERN Vancouver CA*net4 CA*net4 Seattle Portland U Wisconsin NYC Chicago* PSC San Francisco IU DTF 40Gb NCSA Asia-Pacific Caltech Atlanta SDSC AMPATH *ANL, UIC, NU, UC, IIT, MREN

  14. l l l l 10GE 10GE 10GE 10GE OPTera Metro 5200 OPTera Metro 5200 OMNInet Technology Trial @ StarLight Evanston West Taylor GE GE • A four site network in Chicago -- the first 10GE service trial! • A test bed for all-optical switching, advanced high-speed services, and and new applications including high-performance streaming media and collaborative applications for health-care, financial, and commercial services. • Partners: SBC, Nortel, International Center for Advanced Internet Research (iCAIR) at Northwestern, Electronic Visualization Lab at Univ of Illinois, Argonne National Lab, CANARIE Optical Switching Platform Optical Switching Platform Passport 8600 Passport 8600 Application Cluster Application Cluster OPTera Metro 5200 OPTera Metro 5200 S. Federal Lakeshore To Ca*Net4 (future) 10GbE WAN GE GE Optical Switching Platform Passport 8600 Application Cluster Optical Switching Platform Application Cluster Passport 8600 OPTera Metro 5200 OMNInet Technology Trial November 2001

  15. Major Grid networking issues • QoS (Quality of Service) • still largely unresolved on a wide scale because of complexity of deployment • TCP/IP performance over high bandwidth, long distance networks • The loss of a single packet will affect a 10Gbps stream with 200ms RTT (round trip time) for 5 hours. During that time the average throughput will be 7.5 Gbps. • End to end performance in the presence of firewalls • There is a lack of products, can we rely on products becoming available or should a new architecture be evolved? The EU DataTAG Project

  16. Multiple Gigabit/second networking Facts, Theory & Practice • FACTS: • Gigabit Ethernet (GBE) nearly ubiquitous • 10GBE coming very soon • 10Gbps circuits have been available for some time already in Wide Area Networks (WAN). • 40Gbps is in sight on WANs, but what after? • THEORY: • 1GB file transferred in 11 seconds over a 1Gbps circuit (*) • 1TB file transfer would still require 3 hours • and 1PB file transfer would require 4 months • PRACTICE: • Rather disappointing results are obtained on high bandwidth, large RTT networks. • Multiple streams have become the norm (*) according to the 75% empirical rule The EU DataTAG Project

  17. Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow) Streams/Throughput 10 5 1 7.5 4.375 2 9.375 10 Avg. 7.5 Gbps Throughput Gbps 7 5 Avg. 6.25 Gbps Avg. 4.375 Gbps 5 Avg. 3.75 Gbps 2.5 T = 2.37 hours! (RTT=200msec, MSS=1500B) Time T T T T The EU DataTAG Project

More Related