1 / 45

eVLBI Research in the European VLBI Network

eVLBI Research in the European VLBI Network. Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands parsley@jiv.nl. Outline. European VLBI Network (EVN) European Research Networks Fibre Connection to Dwingeloo iGrid Demonstration EVN-NREN: Proof of Concept Project.

shel
Download Presentation

eVLBI Research in the European VLBI Network

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. eVLBI Research in theEuropean VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands parsley@jiv.nl

  2. Outline • European VLBI Network (EVN) • European Research Networks • Fibre Connection to Dwingeloo • iGrid Demonstration • EVN-NREN: Proof of Concept Project

  3. The European VLBI Network

  4. EVN Telescopes

  5. Correlator

  6. European Research Networks • National • NREN = National Research and Education Network • UKERNA, SURFnet, GARR, DFN, PSNC, NORDUnet ….. • International • GÉANT = Pan-European Research Network

  7. GÉANT: Access of NRENs to GÉANT 0 HU CH IT SE FR DE GR NL CZ BE GEANT AT 2.5 G 1.2 G GEANT UK PT 622M ES 310 M SI PL IE 155 M 34 M 45 M HR LU EE RO EVN telescope SK LV BG IL CY LT

  8. 0 10 Gbps EE LV LT 2.5 Gbps 34 45 155 UK SE PL 155 SE - PoP for Nordunet IE LU NL 155 155 155 BE FR DE CZ ES SK PT 622 34 CH IT AT HU RO 622 155 34 HR SI BG 622 34 622 34 GR CY IL 45 GÉANT: The connectivity at 10 Gbps

  9. 20 km of new fibre 180km to SARA via installed link Dwingeloo 3 colours @1Gbps from Dwingeloo to Amsterdam Internet Exchange

  10. Network SARA – ASTRON / JIVE SARA GX ASTRON / JIVE ISDN ISDN SNET-LAN Cisco1721 Cisco2620 Access toNetherLight RS 232 RS 232 GbE GbE ODF ODF ODF ODF Project eVLBI GbE 4912G Cisco15252 DWDM Cisco15216 EDFA (2x) Cisco15252 DWDM Access to SURFnet5 (ar5.amsterdam1) GbE ASTRON router Amsterdam1 Emmeloord1 Dwingeloo1

  11. i Grid2oo2 The International Virtual Laboratory www.startap.net/igrid2002 www.igrid2002.org (COMING SOON) 24-26 September 2002 Amsterdam Science and Technology Centre (WTCW) The Netherlands Call for Applications with Insatiable Bandwidth Appetites! “We hereby challenge the international research community to demonstrate applications that benefit from huge amounts of bandwidth!” iGrid Demonstration

  12. vlb Westerbork Jodrell Bank GEthernet over SURFnet Lambda Dwingeloo Future fibre Link (now it’s a truck) SARA Shared IP over GÉANT Live telescope pictures JIVE Correlator VLBI Technique & Operations World of VLBI Science Other VLBI collaborators Image Fringe Display About VLBI

  13. vlbiGridObjectives • Trial use of UDP for VLBI data transfer across production research networks: • Data rates • Packet loss • Packet reordering • Exercise new link to JIVE • Demonstrate eVLBI fringes • Publicise VLBI to network researchers

  14. iGrid Network Routing NNW MAN iGrid2002 Amsterdam Server SuperJANET4 Core Network SURFnet Core Server Manchester DWDM link PCEVN Geant Core 1 Gbit Eth. 2.5 Gbit Pos 10 Gbit

  15. RingBuffer RingBuffer Data Transfer Process: TCP Control Raid0 Disc Raid0 Disc UDP Data Web Interface

  16. Receiving Packets Incoming packet ids 1 2 3 4 6 • Packets have Header with packet id + Data • Put header directly into control area • Put data directly into ring buffer • No extra copy • Assume UDP packets arrive in order none lost • Deposit data into next consecutive slot • Inspect Header • Move data onward to correct location • Record: • The received inter-packet spacing • 1-way delay 1 2 3 4 Move 6 Continue with 7 Time

  17. iGrid Results • UDP across GÉANT (server-server) : • ~500Mbit/s • <6E-5 lost packets • <1E-5 reordered packets (all exchanges) • FTP to Dwingeloo: • ~40Mbit/s • Normal fringes detected • PR: • Great success, new link used three days after first light • Much interest in VLBI data rates and volumes

  18. iGrid Lessons Learned • 500Mbit/s VLBI data transfer on the production network using a simple UDP based protocol is feasible. • Acceptable packet loss is achievable . • Packets may be re-ordered. Asimple data moving strategy corrects for this. • Control/monitoring data should be on a separate, reliable channel. • End hosts must have sufficient power in both compute cycles and input/out capability. An initial specification would include: • 64bit 66MHz PCI bus • 2 GHz processor • Gigabit Ethernet interface: • Intel Pro 1000 • SysKonnect • Fast disks with high speed buses • Maxtor D740 EIDE 133

  19. Proof of Concept Project (PoC) • Target: • Up to 5 radio telescope sites (not incl NL) connected in real-time to JIVE correlator • Duration: • Up to end of GÉANT contract (Nov 2004) • Support: • Best effort IP service transiting NRENs and GÉANT • No significant upgrades to GÉANT (initially) • Support 512M and 1G real time modes of operation • Use existing NREN access ports • Limited resilience

  20. Proof of Concept Participants • DANTE Pan-European Network • GARR Italian NREN • UKERNA UK NREN • PSNC Polish NREN • DFN German NREN • SURFnet Dutch NREN • KTHNOC/NORDUnet Nordic NREN • Manchester University Network application software • JIVE EVN Correlator • Westerbork telescope Netherlands • Onsala Space Observatory Sweden • MPIfR Germany • Jodrell Bank UK • TCfA Poland • CNR IRA Italy

  21. Success Criteria (for PoC) • NREN/GÉANT point of view: • Connect at least three sites to JIVE • Observe significant usage (time and BW) • EVN point of view: • Same-day imaging of 12hour, 1Gb/s observation • Real time network verification of transient phenomenon

  22. Traffic Engineering on GÉANT...

  23. NORDUnet JANET SURFnet PSNC DFN GARR GÉANT Nodes Affected by EVN Traffic SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  24. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #1 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  25. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #1 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  26. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #2 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  27. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #2 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  28. NORDUnet JANET SURFnet PSNC DFN GARR Potential Upgrades to GÉANT SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  29. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #3 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  30. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #3 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  31. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #4 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  32. NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #4 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT

  33. Some Technical Issues • Packet re-ordering due to architecture of Juniper M160 routers in GÉANT backbone. VLBI UDP application must fix this. • VLBI data rates are restricted to “octaves” • : - 256M, 512M, 1G • “1Gbps” eVLBI flows are >1Gbps •  two GE channels will be needed to support "1Gbps" from each telescope.

  34. NREN1 NREN2 GÉANT NREN3 SURFnet IP1 IP2 IP3 IP4 JIVE

  35. Add second GE NIC for “1Gb/s” each carrying 512Mb/s PoC Design • Separate, GE point-to-point connection for each telescope • GE link on /30 subnet between VLAN interface on the SURFnet access router and the GE NIC at Dwingeloo. JIVE Corr. SURFnet NREN GE GÉANT GE

  36. Local Loops - Status • Italy: • GARR :  Backbone capacity - 2.5Gbps. • Medicina radio telescope: 30km from Bologna POP. Good connectivity (dark fibre) expected by end of 2003. (3-4km dig to radio telescope.) • Poland: • PSNC: 10GE link from Torun to Poznan (location of GÉANT POP) ready in June 2003. • Torun radio telescope: 15km, Torun to telescope in place. 100m and terminal equipment within 3 months. • Germany: • DFN: No backbone problems expected. Bonn ring on-line April’03. 5-7km connection to DFN POP needed but not planned. • Effelsberg Radio Telescope: Fibre to telescope in place bar 5km copper section. • UK: • UKERNA: no problems to support the eVLBI traffic on the SuperJANET backbone. 2.5G backup access port to GÉANT planned. • Jodrell Bank: significant problem with local loop to JB (BT quoted £1M for the first year) Options being explored include “piggy-back” on eMERLIN, 30Gbit/s infrastructure ~June 2003 • Sweden: • NORDUnet: two, redundant 2.5Gbit/s links to GEANT in Stockholm available. • SUNET: 10Gbit/s backbone with 2X2.5Gbit/sSRP links between Chalmer University and Stockholm. • Onsala Space Observatory: 40km of fibre required. Installation costs of up to €150k have been quoted with €20k+ annual charges. • The Netherlands: • SURFnet: 2.5Gbit/s border connection will soon be upgraded to 10Gbit/s • JIVE: 190km dark fibre link from JIVE to Amsterdam (SARA) in place. • Westerbork: 24 fibre link directly to Dwingeloo by June‘03

  37. Project Timeline

  38. NREN1 NREN2 GÉANT NREN3 SURFnet IP1 IP2 IP3 IP4 JIVE

  39. UKLight Proposal • Initiative to attract funding to create: • UK point-of-access (PoA) to the international test-bed • Intra UK optical test-bed • Draft projects: • Development of a common optical control plane • Secure Optical Community Services • A project to use a dark fibre infrastructure • An applications demonstration based upon very long baseline interferometry (VLBI) for Radio Astronomy

  40. Dedicated LambdaVLBI Network

  41. 2nd eVLBI Workshop15-16 May 2003, Dwingeloo, Netherlands • First Announcement 10th Jan ‘03 • Second Announcement 1st March ‘03 • Abstract Deadline 19th March ‘03 • Final Announcement 3rd April ‘03 • Registration Deadline 20th April ‘03 • Hotel Deadline 15th April ‘03 • Workshop 15-16th May ’03 http://www.jive.nl/jive/evlbi_ws/meeting

More Related