1 / 15

DataTAG overview

DataTAG overview. Summary. Why DataTAG? DataTAG project General information Test-bed extensions Network map Research topics Issues Acknowledgements. Background for DataTAG.

marcus
Download Presentation

DataTAG overview

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DataTAG overview SWITCH-cc meeting

  2. Summary • Why DataTAG? • DataTAG project • General information • Test-bed extensions • Network map • Research topics • Issues • Acknowledgements SWITCH-cc meeting

  3. Background for DataTAG • CERN is building the LHC (start-up in 2007?): an unprecedented amount of data will have to be analyzed and CERN alone will not have enough computing resources to process it • The planned computing model is distributed geographically (GRID) • The EU-DataGrid project is addressing the middleware problem • Reliable, advanced networking is needed underneath • Traffic will not look like any IP commodity traffic now • A lot of bandwidth is necessary, but it won’t be enough SWITCH-cc meeting

  4. Addressing the problem • Buy a lot of bandwidth • Buy (expensive) network equipment • Address security issues without compromising performance (firewalls) • Tune some more or less obvious TCP parameter • Design the network for reliability and performance • Plan for interconnection with key research networks SWITCH-cc meeting

  5. Why network research? • Need to enhance data transport protocols (TCP) • Need to measure the perceived application performance • Need to try the GRID software in a WAN environment and at high speed: what is actually going wrong if things go wrong in the network? • Need to test the compatibility between EU and US GRIDs (middleware integration) • Need to test network technology with enough speed and enough features to support the planned GRID workload (end-to-end inter-domain QoS) SWITCH-cc meeting

  6. DataTAG project • “Research and technological development for a trans-atlantic GRID” (project full title) • IST project (EU funded), supported by the NSF and the DoE (Caltech) • Partners: PPARC (UK), INRIA (FR), University of Amsterdam (NL), INFN (IT) and CERN (CH) • Researchers from Caltech, SLAC and Canada • Test-bed kernel: a transatlantic STM-16 (T-systems) between Geneva (CERN) and Chicago (StarLight), with interconnected workstations SWITCH-cc meeting

  7. General information • 2-years project: 2002 and 2003 • Dedicated staff (recruited on project budget) • Part-time staff, shared with other activities • Open to cooperate with other projects: EU-DataGrid, GEANT, Abilene, TeraGrid, NetherLight, etc. • Typical EU work package structure: quarterly reports, deliverables at fixed deadlines, periodic reviews by external inspectors. Very formal and structured framework, but effective to avoid project drifting, delays and wastes SWITCH-cc meeting

  8. DataTAG Network map R06chi-Alcatel7770 R06gva-Alcatel7770 W01chi w02chi w03chi w04chi w05chi w06chi ONS15454 ONS15454 V10chi v11chi v12chi v13chi W01gva w02gva w05gva w06gva SURFNET SURFNET W03gva w04gva Stm16(GC) 4x1GE 1GE 8x1GE 2x1GE CANARIE 2x1GE 2x1GE Alcatel 1670 Alcatel 1670 ONS15454 VTHD/INRIA 2x1GE 10x1GE 4x1GE 2x1GE 1GE 2x1GE Stm16 (FranceTelecom) 1GE 1GE 1GE 2x1GE R05gva-JuniperM10 Stm16(DTag) Extreme Summit5i Extreme Summit1i R05chi-JuniperM10 R04chi-Cisco7609 R04gva-Cisco7606 10GE Stm64(L3) SUNNYVALE 1GE DataTAG 2x1GE Cisco5505-management ABILENE 1GE 10GE Teragrid JuniperT640 Chicago Geneva CERN External Network 1GE Vlan4 Vlan5 SWITCH 1GE Vlan7 1GE Stm4(DTag) 1GE Stm16(Swisscom) Cisco2950-management GEANT Cernh4-Cisco7609 Cernh7-Cisco7609 ar3-chicago -Cisco7606 Stm16(Colt) backup+projects GARR/CNAF edoardo.martelli@cern.ch - last update: 20021204

  9. DataTAG Routing map Management addresses and path to reach them from the internet Datatag testbed addresses Path of the CCC tunnel from CNAF Path between the OC farms in Chicago and Geneva Path between Sunnyvale and the PC farm in Geneva R06gva R06chi W01chi w02chi w03chi w04chi w05chi w06chi V10chi v11chi v12chi v13chi W01gva w02gva w05gva w06gva SURFNET SURFNET W03gva w04gva CANARIE VTHD/INRIA R05gva R05chi R04gva R04chi SUNNYVALE 192.91.236.0/23 192.91.238.0/23 DataTAG Cisco5505-management ABILENE Teragrid JuniperT640 Chicago Geneva CERN External Network 192.91.244.0/27 192.91.246.192/26 SWITCH Cisco2950-management GEANT ar3-chicago Cernh4 Cernh7 GARR/CNAF edoardo.martelli@cern.ch - last update: 20021204

  10. (some) Research topics (I) • Linux kernel tuning for high performance: for example, 8 Terabytes in 24 hours, memory-to-memory (achieved by S .Ravot, Caltech) • Bulk file transfer (Terabyte disk-to-disk, at 2 Gbps, achieved by Canadian researchers between TRIUMF and CERN) • TCP stack improvements (things get worse with longer RTT) • Application-level performance measurement • GRID middleware interoperability between EU and US SWITCH-cc meeting

  11. (some) Research topics (II) • 10 Gb tests (10GbE and transatlantic link upgrade, tentatively in September 2003) at layer 2 and layer 3 • Multi-vendor equipment (Alcatel 1670 and 7770, Cisco 760x, Juniper M10, Extreme Summit switches) • QoS tests, advanced reservation • Optical networking: validation of equipment SWITCH-cc meeting

  12. Issues (I) • Electrical power in Chicago (!!!) • Broken network hardware (mainly 10 GbE cards, but not only) • Broken PCs • Hung routers • Never enough workstations available for testing • Reservation system: it will never be sophisticated enough • Network topology: each research group has different requirements • Alcatel 1670: needs STM-16 reconfiguration SWITCH-cc meeting

  13. Issues (II) • Cisco 760x components (un)availability • Demo workshops (iGRID2002, SC2002, …): nice to see, but organizational nightmares • KPNQwest collapse (re-procurement via T-systems) • Routing: interconnections with CERN production network, with external production networks, with external test networks, even with commodity Internet; furthermore, routing is open for experiments • Management access to devices • OOB access (Chicago) SWITCH-cc meeting

  14. Issues (III) • A lot of enthusiasm and interest, not always supported by adequate planning • When adequate planning is there, it is ignored (because of the enthusiasm, of course) • Partners coordination is not straightforward: mix of shared and private resources • DNS, security, access control, management servers, VLANs, WWW site, IP addressing (>100 addresses assigned), etc.: all need planning, work and maintenance • PoP management (run out of rack space) + installation issues (mainly, but not only, Alcatel) SWITCH-cc meeting

  15. Acknowledgements • DataTAG is for what you would have always liked to do and you never dared to do because it was too risky, or too expensive, or too complicated, or because you could not afford a test laboratory • Many thanks to DANTE/GEANT and DoE/Caltech, who are actively supporting the project • http://www.datatag.org SWITCH-cc meeting

More Related