1 / 14

Connecting LOFAR to the GRID

Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007. Connecting LOFAR to the GRID. First result: 96 LBA antennas Upto 400 m apart Dynamic range: ~1000:1 Cas A (strongest source) removed from image. LOFAR operational model. LOFAR Central systems.

cordero-chavez
Download Presentation

Connecting LOFAR to the GRID

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hanno Holties, ASTRON IVOA - OGF Astro-RG Work Shop Manchester, 9th May 2007 Connecting LOFAR to the GRID

  2. First result: • 96 LBA antennas • Upto 400 m apart • Dynamic range: ~1000:1 • Cas A (strongest source) removed from image

  3. LOFAR operational model

  4. LOFAR Central systems • Process ‘raw’ data • Calibration • Reduce in size • Temporary Storage • Raw data: 5 days • Processed dataproducts: 1 month • Push data to users • Science centers subscribe & publish storage location • LOFAR scheduler initiates • …or interactive

  5. The LOFAR Network & GRID GRID Science centers International LOFAR stations 2 Gbps lightpaths Computing centers LOFARinstrument (Dutch part) 20 Gbps lightpaths 700 Gbps dedicated fibre Science center with local storage

  6. GRID utilization • Long term storage • In general at computing center • Searchable database • Data mining • Virtual Observatory • Offline processing • Reprocessing • Source extraction • Differencing(search for variable or new sources)

  7. Storage requirements • Required storage capacity depends on • Datatype (timeseries, visibilities, images) • Number of stations involved • Required time, frequency, and spatial resolution Prognosis1.8 PB/Yr

  8. Processing requirements • In process of being defined • Applications still being developed • GRID awareness of scientists just starting • Proximity to, and available bandwidth for, storage • IO limited • Operate on Multi-Terabyte datasets • Mostly embarrassingly parallel • Environment • Application requirements • HPC tuning requires system details • Shield from scientist

  9. Where are we? • Working group LOFAR & GRID • Meets on monthly basis • Users, RCG, SARA, NIKHEF, ASTRON/LOFAR • EGEE Tutorial before the summer • LOFAR VO (in GRID context) • Group for each KSP (to become per science center) • Resources at SARA; RCG to follow shortly • Glite TAR-UI installed on storage frontend • Some groups have started to get their feet wet • Kapteyn Institute • UvA Transients group

  10. eLOFAR: The extended LOFAR • Interest from international partners in: • Germany (www.lofar.de) • UK (www.lofar-uk.org) • France • Sweden • Italy • Poland • Aiming to extend LOFAR with: • International stations • Science Centers. • Computing centers

  11. LOFAR challenges for GRID • Storage • 20 Gbps sustainable bandwidth • Multi-Petabyte growth per year • Interactive databases • Processing • Operate on Multi-TB datasets • Applications with varying requirements • Usability • Reliable facilities • Technical details shielded from (general) user

More Related