1 / 16

FABRIC first year progress report

Detailed report on the progress made in the first year of the EXPReS project, focusing on broadband data acquisition using 10Gbps Internet, new filtering hardware, protocol optimization, and telescope interface development.

jlabombard
Download Presentation

FABRIC first year progress report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FABRICfirst year progress report Huib van Langevelde, JIVE EXPReS is made possible through the support of the European Commission (DG-INFSO), Sixth Framework Programme, Contract #026642

  2. Broadband Data acquisition to work with 10Gbps Internet Requires new filtering and sampling hardware Optimize protocol Calibration issues and control software interface to telescope Interfaces from public domain transport to “private” LOFAR e-MERLIN Prototype and test Onsala telescope on e-MERLIN Internet computing Use Grid for calculating correlation function Based on virtual lab projects Workflow management Load balancing Deployable software correlator Based on previous Huygens machine Suitable for Grid nodes and parallel computing Data quality control, display and merging 5 station demonstrator With new science capabilities Future Arrays of Broadband Radio-telescopes on Internet Computing WP 2 WP 1 EXPReS midterm review

  3. Data acquisition WP 1.1.1 MRO • Requirements formulated • Quite complex decision to be made • Recording: Mk5 and PCEVN systems available • Sampling: dBBC and DBE under development • Compatibility with correlators • And e-MERLIN in/out • Decision reached • iBOB: • Internet BreakOut Boards • University of Berkeley • FPGA and 2 x 10 Gbps • ADC converter port • R+D into radically different solution EXPReS midterm review

  4. e-MERLIN interface WP 1.2.2 UniMan • Connect 4Gbps streams (Onsala) • To feed into e-MERLIN correlator • Compatible to MERLIN channelization • Same architecture as MERLIN out (SA1) • And as data-acquisition • Design started • Hardware ordered • Personnel found • Joint with SA1 EXPReS midterm review

  5. Protocol research WP 1.2.1 UniMan • Various testbeds • with range of controls in e.g. dropout • Protocols adressed • TCP certainly not optimal • UDP more promising • VSI-E needs more tests • DCCP not robust yet • Currently contributed effort by UniMan • Engineer available for FABRIC work later this year • Will bring more specific focus • Strategic discussion document delivered EXPReS midterm review

  6. Testing Onsala/7 month demo WP 1.2.3 OSO • Onsala will do 4Gbps demo • Joining the e-MERLIN array • Bandwidth upgrade under negotiation • Did PC-EVN test • Transfer at high rate • Using Tsunami • Direct transport • To JIVE • Or Metsähovi • Correlation at JIVE • Very useful exercise EXPReS midterm review

  7. LOFAR connectivity • Similar to e-MERLIN • E-LOFAR stations on public network? • Interface issues • And timing • Also for clock distribution • Discussions started • strategic doc delivered WP 1.2.4 ASTRON EXPReS midterm review

  8. Distributed correlation • Correlation currently in dedicated silicon • Special purpose computer • With 2 bit operations • At 100 T-ops • Future needs at 20 P-ops • Can be done on custom computers with 1op=1flop • Interesting science demo would take a few cluster computers • Software correlation can outperform 2 bit operation EXPReS midterm review

  9. WP 2.1.1 PSNC eVLBI-Grid collaboration • Connect telescopes and correlator nodes • Need to be deployed on Grid • Based on virtual laboratory • Required a lot of design • PSNC group new to VLBI • JIVE group new to Grid • 2.9 documents produced • Challenge: resource allocation • Issues with data from Mk5 system • Reached next stage • Workflow manager • Integrating correlator core midterm review

  10. WP 2.1.2 PSNC EXPReS midterm review

  11. Deployable software correlator Cluster computer enabled Grid enabled Starts with special purpose algorithm for Huygens mission Extreme high spectral resolution Keep for future applications Can have better signal to noise performance than 2-bit Interesting astronomy applications Code transferred to standard environment Runs on cluster computers But not yet optimized Software correlator WP 2.2.1 JIVE EXPReS midterm review

  12. Correlator core WP 2.2.2 JIVE EXPReS midterm review

  13. Management • Distributed project with >30 participants • In 7 institutes and >4 disciplines • Communication • Meetings: kick-off meeting in Dwingeloo 22 Mar 2006 business meeting Poznan 27 Sep 2006 few teleconferences • Splinter meetings & visits: correlator, protocols, iBOB • Wiki for sharing documents • E-mail exploder with some external parties • Original work package structure quite good EXPReS midterm review

  14. Challenges • Design hurdle for data acquisition • iBOB rather drastic new development route • Large investment in existing technologies • Decisions took some time, purchases even more • Personnel acquisition dependent as well • Bridge the gap between eVLBI and Grid • Took several iterations and meetings • Teams with variety of expertise • And strong opinions EXPReS midterm review

  15. Personnel issues • Kick-off in March 2006 • Direct start at Poznan and partially at JIVE • Other post-doc level people JIVE took 6 & 9 months • At JBO digital engineer is shared with SA1 • Protocol person only available in 2007 • Lot of the work done by ‘matching’ effort • OK for the design phase • Project manager is now also coordinator • Definitely delayed the integrated design document EXPReS midterm review

  16. Milestones EXPReS midterm review

More Related