1 / 22

The EU DataTAG Project

The EU DataTAG Project. Presented at the 4 th DataGrid Conference 8 th March 2002, PARIS Olivier H. Martin CERN - IT Division. The project . European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator.

alaina
Download Presentation

The EU DataTAG Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The EU DataTAG Project Presented at the 4th DataGrid Conference 8th March 2002, PARIS Olivier H. Martin CERN - IT Division

  2. The project • European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator. • INRIA (FR) expected to join during 1H2002. • ESA/ESRIN (IT) will provide Earth Observation demos together with NASA. • Budget: 3.98 MEUR • Start date: January, 1, 2002 • Duration: 2 years (aligned on DataGrid) • Funded manpower: ~ 15 persons/year The EU DataTAG Project

  3. US Funding & collaborations • US NSF support through the existing collaborative agreement with CERN (Eurolink award). • US DoE support through the CERN-USA line consortium. • Significant contributions to the DataTAG workplan have been made by Jason Leigh (EVL@University of Illinois), Joel Mambretti (Northwestern University), Brian Tierney (LBNL). • Strong collaborations already in place with ANL, Caltech, FNAL, SLAC, University of Michigan, as well as Internet2 and ESnet. The EU DataTAG Project

  4. In a nutshell • Two main focus: • Grid related network research (WP2, WP3) • Interoperability between European and US Grids (WP4) • 2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago) around July 2002. • Dedicated to research (no production traffic) • In principle open to other EU Grid projects as well as ESA for demonstrations The EU DataTAG Project

  5. Goals & outcomes • End to end Gigabit Ethernet performance using innovative high performance transport protocols. • Assess inter-domain QoS and bandwidth reservation techniques. • Interoperability between some major GRID projects in Europe and North America • DataGrid, possibly other EU funded Grid projects • PPDG, GriPhyN, Teragrid, iVDGL (USA) The EU DataTAG Project

  6. UK SuperJANET4 NL SURFnet GEANT IT GARR-B DataTAG project NewYork Abilene STAR-LIGHT ESNET CERN MREN STAR-TAP Major 2.5 Gbps circuits between Europe & USA

  7. Project positioning • Why yet another 2.5 Gbps transatlantic circuit? • Most existing or planned 2.5 Gbps transatlantic circuits are for production, which makes them basically not suitable for advanced networking experiments that require a great deal of operational flexibility in order to investigate new application driven network services, e.g.: • deploying new equipment (routers, G-MPLS capable multiplexers), • activating new functionality (QoS, MPLS, distributed VLAN) • The only known exception to date is the Surfnet circuit between Amsterdam & Chicago (Starlight) • Concerns: • How far beyond Starlight can DataTAG extend? • How fast will US research network infrastructure match that of Europe! The EU DataTAG Project

  8. The STAR LIGHT • Next generation STAR TAP with the following main distinguishing features: • Neutral location (Northwestern University) • 1/10 Gigabit Ethernet based • Multiple local loop providers • Optical switches for advanced experiments • The STAR LIGHT will provide 2*622 Mbps ATM connection to the STAR TAP • Started in July 2001 • Also hosting other advanced networking projects in Chicago & State of Illinois N.B. Many European Internet Exchanges Points have already been deployed along the same lines. The EU DataTAG Project

  9. Major Grid networking issues • QoS (Quality of Service) • still largely unresolved on a wide scale because of complexity of deployment • TCP/IP performance over high bandwidth, long distance networks • The loss of a single packet will affect a 10Gbps stream with 200ms RTT (round trip time) for 5 hours. During that time the average throughput will be 7.5 Gbps. • On the 2.5Gbps DataTAG circuit with 100ms RTT, this translates to 38 minutes recovery time, during that time the average throughput will be 1.875Gbps. • Line Error rates • A 2.5 Gbps circuit can absorb 0.2 Million packets/second • Bit error rates of 10E-9 means one packet loss every 250 mseconds • Bit error rates of 10E-11 means one packet loss every 25 seconds • End to end performance in the presence of firewalls • There is a lack of products, can we rely on products becoming available or should a new architecture be evolved? • Evolution of LAN infrastructure to 1Gbps/10Gbps • Uniform end to end bandwidth The EU DataTAG Project

  10. Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow) Streams/Throughput 10 5 1 7.5 4.375 2 9.375 10 Avg. 7.5 Gbps Throughput Gbps 7 5 Avg. 6.25 Gbps Avg. 4.375 Gbps 5 Avg. 3.75 Gbps 2.5 T = 2.37 hours! (RTT=200msec, MSS=1500B) Time T T T T The EU DataTAG Project

  11. Workplan (1) • WP1: Provisioning & Operations (P. Moroni/CERN) • Will be done in cooperation with DANTE & National Research & Education Networks (NREN) • Two main issues: • Procurement (largely done already for what concerns the circuit, equipment still to be decided). • Routing, how can the DataTAG partners access the DataTAG circuit across GEANT and their national network? • Funded participants: CERN(1FTE), INFN (0.5FTE) • WP5: Information dissemination and exploitation (CERN) • Funded participants: CERN(0.5FTE) • WP6: Project management (CERN) • Funded participants: CERN(2FTE) The EU DataTAG Project

  12. Workplan (2) • WP2: High Performance Networking (Robin Tasker/PPARC) • High performance Transport • tcp/ip performance over large bandwidth*delay networks • Alternative transport solutions using: • Modified TCP/IP stack • UDP based transport conceptually similar to rate based TCP • End to end inter-domain QoS • Advance network resource reservation • Funded participants: PPARC (2FTE), INFN (2FTE), UvA (1FTE), CERN(1FTE) The EU DataTAG Project

  13. Workplan (3) • WP3: Bulk Data Transfer & Application performance monitoring (Cees deLaat/UvA) • Performance validation • End to end user performance • Validation • Monitoring • Optimization • Application performance • Netlogger • Funded participants: UvA (2FTE), CERN(0.6FTE) The EU DataTAG Project

  14. WP4 Workplan(Antonia Ghiselli & Cristina Vistoli / INFN) • Main Subject: • Interoperability between EU and US Grids services from DataGrid, GriPhyN, PPDG and in collaboration with iVDGL, for the HEP applications. • Objectives: • Produce an assessment of interoperability solutions • Provide test environment to LHC Applications to extend existing use-cases to test interoperability of the grid components • Provide input to a common Grid LHC architecture • Plan EU-US Integrated grid deployment • Funded participants: INFN (6FTE), PPARC (1FTE), UvA (1FTE) The EU DataTAG Project

  15. WP4 Tasks Assuming the same grid basic services (gram,gsi,gris) between the differen grid projects, the main issues are: • 4.1 resource discovery, coord. C.Vistoli • 4.2 security/authorization, coord. R.Cecchini • 4.3 interoperability of collective services between EU-US grid domains, coord. F.Donno • 4.4 test applications, contact people from each application : • Atlas / L.Perini, CMS / C.Grandi, • Alice / P.Cerello The EU DataTAG Project

  16. DataTAG/WP4 framework and relationships Grid projects: DataGrid PPDG Griphyn LCG Globus Condor ….. input feedback ….. Grid Interoperability Activities: DataTAG/WP4 iVDGL HICB/HIJTB GGF Integration stardardization Proposals ….. Applications: LHC experiments CDF Babar ESA The EU DataTAG Project

  17. WP4.1 - Resource DiscoveryObjectives • Enabling an interoperable system that allows for the discovery and access of the Grid services available at participant sites of all Grid domains, in particular between EU and US Grids. • Compatibility of the Resource Discovery System with the existent components/services of the available GRID systems. The EU DataTAG Project

  18. Task 4.1 Time Plan • Reference agreement document on resource discovery schema by 31st of May 2002 • “INTERGRID VO” MDS test by 31st of July 2002 • Evaluation of the interoperability of multiple Resource Discovery Systems (FTree, MDS, etc…) by 30th of September 2002 • Network Element by 31st of December 2002 • Impact of the new Web Services Technology by 31st of June 2003 • Identify missing components. by 31st of June 2003 • Final deployment. by 31st of December 2003 The EU DataTAG Project

  19. WP4.2 - Objectives • Identify Authentication, Authorization and Accounting (AAA) mechanisms allowing interoperability between grids • Compatibility of the AAA mechanisms with the existing components/services of the available GRID systems. The EU DataTAG Project

  20. Task 4.2 Time Plan • Reference document • Issues • Minimum requirements for DataTAG CA’s; • Analysis of available authorization tools and policy languages and their suitability (in cooperation with the DataGrid Authorization WG); • Mapping of the policies of the VO domains; • Information exchange protocol between the authorization systems; • Feasibility study of an accounting system (in cooperation with the DataGrid WP1); First draft: 31 July 2002 Final version: 30 April 2003 • Deployment First: 30 September 2002 Final: 31 December 2003 The EU DataTAG Project

  21. WP4.3 / WP4.4 - Objectives • Identify grid elements in EU and US grid projects, Identify common components in the testbeds used by the HEP experiments for semi-production activities in EU and US and classify them in an architectural framework. • Plan and Setup “InterGrid VO” environment with common EU-US services. • Deployment of an EU-US VO domain in collaboration with iVDGL. The EU DataTAG Project

  22. Task 4.3/4.4 Time Plan The time plan will follow the schedule of each experiment • Study of exp. Layout and Classification – first result by 31st of June 2002 • First deployment (already started) by 31st of September 2002 • First report of integration and interoperability issues by 30th of December 2002 • First working version of a VO EU-US domain by 31st of June 2003 • Complete deployment. by 31st of December 2003 The EU DataTAG Project

More Related