440 likes | 559 Views
eVLBI Research in the European VLBI Network. Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands parsley@jiv.nl. Outline. European VLBI Network (EVN) European Research Networks eVLBI experience Future plans. The European VLBI Network. EVN Telescopes.
E N D
eVLBI Research in theEuropean VLBI Network Steve Parsley Joint Institute for VLBI in Europe Dwingeloo, Netherlands parsley@jiv.nl
Outline • European VLBI Network (EVN) • European Research Networks • eVLBI experience • Future plans
European Research Networks • National • NREN = National Research and Education Network • UKERNA, SURFnet, GARR, DFN, PSNC, NORDUnet ….. • International • GÉANT = Pan-European Research Network
GÉANT: Access of NRENs to GÉANT 0 HU CH IT SE FR DE GR NL CZ BE GEANT AT 2.5 G 1.2 G GEANT UK PT 622M ES 310 M SI PL IE 155 M 34 M 45 M HR LU EE RO EVN telescope SK LV BG IL CY LT
0 10 Gbps EE LV LT 2.5 Gbps 34 45 155 UK SE PL 155 SE - PoP for Nordunet IE LU NL 155 155 155 BE FR DE CZ ES SK PT 622 34 CH IT AT HU RO 622 155 34 HR SI BG 622 34 622 34 GR CY IL 45 GÉANT: The connectivity at 10 Gbps
20 km of new fibre 180km to SARA via installed link Dwingeloo 3 colours @1Gbps from Dwingeloo to Amsterdam Internet Exchange
Network SARA – ASTRON / JIVE SARA GX ASTRON / JIVE ISDN ISDN SNET-LAN Cisco1721 Cisco2620 Access toNetherLight RS 232 RS 232 GbE GbE ODF ODF ODF ODF Project eVLBI GbE 4912G Cisco15252 DWDM Cisco15216 EDFA (2x) Cisco15252 DWDM Access to SURFnet5 (ar5.amsterdam1) GbE ASTRON router Amsterdam1 Emmeloord1 Dwingeloo1
i Grid2oo2 The International Virtual Laboratory www.startap.net/igrid2002 www.igrid2002.org (COMING SOON) 24-26 September 2002 Amsterdam Science and Technology Centre (WTCW) The Netherlands Call for Applications with Insatiable Bandwidth Appetites! “We hereby challenge the international research community to demonstrate applications that benefit from huge amounts of bandwidth!” iGrid Demonstration
vlb Westerbork Jodrell Bank GEthernet over SURFnet Lambda Dwingeloo Future fibre Link (now it’s a truck) SARA Shared IP over GÉANT Live telescope pictures JIVE Correlator VLBI Technique & Operations World of VLBI Science Other VLBI collaborators Image Fringe Display About VLBI
RingBuffer RingBuffer Data Transfer Process: TCP Control Raid0 Disc Raid0 Disc UDP Data Web Interface
Receiving Packets Incoming packet ids 1 2 3 4 6 • Packets have Header with packet id + Data • Put header directly into control area • Put data directly into ring buffer • No extra copy • Assume UDP packets arrive in order none lost • Deposit data into next consecutive slot • Inspect Header • Move data onward to correct location • Record: • The received inter-packet spacing • 1-way delay 1 2 3 4 Move 6 Continue with 7 Time
iGrid Lessons Learned • 500Mbit/s VLBI data transfer on the production network using a simple UDP based protocol is feasible. • Acceptable packet loss is achievable . • Packets may be re-ordered. Asimple data moving strategy corrects for this. • Control/monitoring data should be on a separate, reliable channel. • End hosts must have sufficient power in both compute cycles and input/out capability. An initial specification would include: • 64bit 66MHz PCI bus • 2 GHz processor • Gigabit Ethernet interface: • Intel Pro 1000 • SysKonnect • Fast disks with high speed buses • Maxtor D740 EIDE 133
Proof of Concept Project (PoC) • Target: • Up to 5 radio telescope sites (not incl NL) connected in real-time to JIVE correlator • Support: • Best effort IP service transiting NRENs and GÉANT • No significant upgrades to GÉANT (initially) • Support 512M and 1G real time modes of operation • Use existing NREN access ports • Limited resilience
Success Criteria (for PoC) • NREN/GÉANT point of view: • Connect at least three sites to JIVE • Observe significant usage (time and BW) • EVN point of view: • Same-day imaging of 12hour, 1Gb/s observation • Real time network verification of transient phenomenon
Proof of Concept Participants • DANTE Pan-European Network • GARR Italian NREN • UKERNA UK NREN • PSNC Polish NREN • DFN German NREN • SURFnet Dutch NREN • KTHNOC/NORDUnet Nordic NREN • Manchester University Network application software • JIVE EVN Correlator • Westerbork telescope Netherlands • Onsala Space Observatory Sweden • MPIfR Germany • Jodrell Bank UK • TCfA Poland • CNR IRA Italy
NORDUnet JANET SURFnet PSNC DFN GARR GÉANT Nodes Affected by EVN Traffic SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #1 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #2 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #2 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Potential Upgrades to GÉANT SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #3 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #3 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NORDUnet JANET SURFnet PSNC DFN GARR Failure Scenarios #4 SE UK PL CZ BE NL DE2 DE1 FR CH AT 2.5G 10G IT
NREN1 NREN2 GÉANT NREN3 SURFnet IP5 IP1 IP2 IP3 IP4 JIVE
PoC Design • Separate, GE point-to-point connection for each telescope • GE link on /30 subnet between VLAN interface on the SURFnet access router and the GE NIC at Dwingeloo. JIVE Corr. SURFnet NREN GE GÉANT GE
Local Loops - Status • Italy: • GARR : Backbone capacity - 2.5Gbps. • Medicina radio telescope: 30km from Bologna POP. Good connectivity (dark fibre) expected by end of 2003. (3-4km dig to radio telescope.) • Poland: • PSNC: 10GE link from Torun to Poznan (location of GÉANT POP) ready in June 2003. • Torun radio telescope: 15km, Torun to telescope in place. 100m and terminal equipment within 3 months. • Germany: • DFN: No backbone problems expected. Bonn ring on-line April’03. 5-7km connection to DFN POP needed but not planned. • Effelsberg Radio Telescope: Fibre to telescope in place bar 5km copper section. • UK: • UKERNA: no problems to support the eVLBI traffic on the SuperJANET backbone. 2.5G backup access port to GÉANT planned. • Jodrell Bank: significant problem with local loop to JB (BT quoted £1M for the first year) Options being explored include “piggy-back” on eMERLIN, 30Gbit/s infrastructure ~June 2003 • Sweden: • NORDUnet: two, redundant 2.5Gbit/s links to GEANT in Stockholm available. • SUNET: 10Gbit/s backbone with 2X2.5Gbit/sSRP links between Chalmer University and Stockholm. • Onsala Space Observatory: 40km of fibre required. Installation costs of up to €150k have been quoted with €20k+ annual charges. • The Netherlands: • SURFnet: 2.5Gbit/s border connection will soon be upgraded to 10Gbit/s • JIVE: 190km dark fibre link from JIVE to Amsterdam (SARA) in place. • Westerbork: 24 fibre link directly to Dwingeloo by June‘03
NREN1 NREN2 GÉANT NREN3 SURFnet IP5 IP1 IP2 IP3 IP4 JIVE
UKLight Proposal • Initiative to attract funding to create: • UK point-of-access (PoA) to the international test-bed • Intra UK optical test-bed • Draft projects: • Development of a common optical control plane • Secure Optical Community Services • A project to use a dark fibre infrastructure • An applications demonstration based upon very long baseline interferometry (VLBI) for Radio Astronomy
2nd eVLBI Workshop15-16 May 2003, Dwingeloo, Netherlands • Hotel Deadline 15th April ‘03 • Registration Deadline 20th April ‘03 http://www.jive.nl/jive/evlbi_ws/meeting