140 likes | 266 Views
The DataTAG Project 25 March, Brussels FP6 Information Day. http://www.datatag.org. Peter Clarke, University College London. DataTAG Mission. T rans A tlantic G rid. EU US Grid network research High Performance Transport protocols Inter-domain QoS Advance bandwidth reservation
E N D
The DataTAG Project 25 March, Brussels FP6 Information Day http://www.datatag.org Peter Clarke, University College London
DataTAG Mission TransAtlantic Grid • EU US Grid network research • High Performance Transport protocols • Inter-domain QoS • Advance bandwidth reservation • EU US Grid Interoperability • Sister project to DataGRID DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Collaborations • Collaboration with Networks • DANTE and National Research Networks (NRN) • GARR (IT), MB-NG (UK), Surfnet (NL), VTHD (FR) • Internet2/Abilene, Starlight, TeraGrid, ESnet, Canarie • Collaboration with projects in Europe • DataGrid/CrossGrid • Gridstart • National Grid projects (e.g. IT) • LHC Computing Grid (LCG) • Collaboration with projects in the US • Globus • iVDGL • GriPhyN • PPDG DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Brunel University CERN CLRC DANTE INRIA NIKHEF PPARC UvA University of Manchester UCL EU collaborators DataTAG - EU FP6 Information Day - Brussels 25 March 2003
ANL Caltech Fermilab University of Chicago FSU Indiana Wisconsin Globus Northwestern University UIC University of Michigan SLAC Starlight US collaborators DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Funding agencies Cooperating Networks DataTAG - EU FP6 Information Day - Brussels 25 March 2003
UK SuperJANET4 NL ATRIUM/VTHD FR INRIA SURFnet GEANT IT GARR-B Network Research Testbed NewYork Abilene 3*2.5G STAR-LIGHT ESNET CERN 2.5G --> 10G 10G MREN STAR-TAP DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Phase I (iGRID2002) DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Intel 10GigE Data Transfer Trial On February 27-28, a Terabyte of data was transferred by S. Ravot of Caltech between the Level3 PoP in Sunnyvale near SLAC and CERN through the TeraGrid router at StarLight from memory to memoryas a single TCP/IP stream with 9KB Jumbo frames at a rate of 2.38 Gbps for 3700 seconds.This beat the former record by a factor of approximately 2.5, and used the US-CERN link at 96% efficiency. This is equivalent to: Transferring a full CD in 2.3 seconds (i.e. 1565 CDs/hour)Transferring 200 full length DVD movies in one hour (i.e. 1 DVD in 18 seconds) European Commission DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Objectives EU US Grid Interoperability • Enable Middleware interoperability between European and US Grid domains • Demonstrate Large Hadron Collider (LHC) Applications running on heterogeneous Grid Issues • Resource Discovery • Authentication & Authorisation • Job scheduling • Data Management DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Results • Common Resource Information Publication • DataGrid Resource Broker and common Information system integration • Implementation in standard Globus release • To be included in next DataGrid Release • Already included in US VDT release and CERN LCG-0 release • Input to GGF and CIM DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Results • Common Virtual Organization Authorization system (VOMS) • jointly developed by DataTAG/DataGRID • Mapping between PKI-based Grid security and Kerberos-based mechanism at the local site. • New Grid monitoring system DataTAG - EU FP6 Information Day - Brussels 25 March 2003
40000 35000 30000 25000 Hits 20000 15000 10000 5000 0 Feb-02 Apr-02 May-02 Jul-02 Sep-02 Oct-02 Dec-02 Jan-03 Mar-03 Month Dissemination • Web site • Presentations • GGF, DataGrid, Internet2, AcrossGrid, Nordunet, INFN-Grid, Gridstart, HNF Europe, IST2002, SC2002, etc • Demos • iGRID2002, IST2002, SC2002 • High Performance TCP workshop 40000/month DataTAG - EU FP6 Information Day - Brussels 25 March 2003
Conclusions • Successfull first year • Comprehensive Transatlantic testbed built • Many advances in very high rate data transport • Demonstration of applications running across heterogeneous Grid domains DataTAG - EU FP6 Information Day - Brussels 25 March 2003