1 / 31

EURO-VO DCA GRID and the VO

EURO-VO DCA GRID and the VO. Lofar Information System Design OmegaCEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008. Edwin A. Valentijn. LOFAR @ (20-)30-80 MHz and 120-240 MHz. EoR - transients Survey astroparticles.

Download Presentation

EURO-VO DCA GRID and the VO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. EURO-VO DCA GRID and the VO Lofar Information System Design OmegaCEN Kapteyn Institute TARGET- Computing Center University Groningen Garching, 10 April 2008 Edwin A. Valentijn

  2. LOFAR @ (20-)30-80 MHz and 120-240 MHz • EoR • - transients • Survey • astroparticles

  3. E-Lofar: from experiment to observatory

  4. LOFAR in short • Large distributed radio telescope • In NL 2008: initial roll out 20 stations • In NL 2009: 18 central (24 Gbps) + 18 remote (2 Gbps) phased array antenna stations each ~4 soccerfields size • Full scale aperture synthesis array, extends 100km • Two main bands • High Band ~ 7,500 tiles 120 – 240 MHz • Low Band ~ 7,500 dipoles 20 – 80 MHz • DigitalRadio 40 MHz processing bandwidth • Extreme tunabilityin time/space/frequency • Large instantaneous sky coverage • Fibre network, SoftwareCorrelator • Run as a broad common-user observatory • Making the transition now from “project” to “observatory”

  5. E-LOFAR Participants • GLOW: -- Effelsberg station delivered -- Garching, Potsdam, Tautenburg stations ordered --Jülich station federal funding proposal submitted • LOFAR-UK: – Chilbolton, Cambridge, Jodrell, Edinburgh – 1 station funded, site to be chosen --3 more stations • Sweden: – Onsala station funded • + Poland, Italy, Austria, Bulgaria, Ireland, France

  6. Wires in the field

  7. Used for 1 beam & station cross correlation • 1GbE • 10 GbE • Beamformer • Beamformer • Beamformer • Beamformer • Filter • Filter • Filter • Filter • Buffer • Buffer • Buffer • Buffer • Receiver • Receiver • Receiver • Receiver Station based processing • Input data rate: ~ 460 Gbps • Output data rate: ~ 2 Gbps • Processing capacity: ~ 1.5 Tmul/s • Storage capacity: 96 Gbyte

  8. Lofar: Data Stream

  9. Lofar Storage

  10. Lofar Long term (>2weeks)archive and user enabling ADD

  11. STREAM of MetaData • Design: data driven vs. compute driven • from the field to central processor • Distributed – p2p / federated • Communities • Dataservers – own + EGEE GRID • Compute servers – own+ EGEE GRID • AstroWISE • EURO - VO

  12. LoWISE design

  13. Lofar-WISE: Data Storage • Groningen • SARA Amsterdam

  14. IBM – GPFS filesystem • Connect to AstroWISE • Storage table

  15. LoWise- concepts • All Tier 1s on an equal footing • Centrally operated GPFS distributed filesystem • File retrieval • Db viewer (web) • Prompt (db query) • Pathname – data server • gLite – Grid ftp • Single distributed db- with all Meta and source data • Valid --Quality -- ready for publication flags • Visibility of data • Owner –Project –Archive --EURO-VO • Authentication / Assigned resources • AstroWISE Oracle system

  16. Processing - options • Tier 0 – CP • Tier 1 – re-processing • Local clusters • EGEE GRID • Tier 2 • On Tier 1 • Local anarchy

  17. AstroWISE-Up

  18. VST - Virtual Survey Telescope

  19. www.astro-wise.org

  20. Astro-WISE: Services

  21. TARGET diagram

  22. QC - calibration scientist monitoring

  23. Extreme data lineage

  24. Astro-WISE: Grid Computing • selection of Target in Astro-Wise • storage element defined a priori • EGEE computing

  25. LoWise and Euro-VO

  26. GRID- EuroVO –Awe visualization

  27. AI – Cultural Heritage

  28. http://omegate.astro.rug.nl:9001/Monk

More Related