1 / 14

a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO

a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO. Edwin A. Valentijn. statement. Big steps with small groups of people serve individual research groups don’t set out to heal the world sociology Astronomers and very large db 1989 ESO-LV 30.000 images Work station

lynch
Download Presentation

a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. a Virtual Survey System AstroWise- OmegaCAM – Lofar – Euro-VO Edwin A. Valentijn

  2. statement • Big steps with small groups of people • serve individual research groups • don’t set out to heal the world • sociology • Astronomers and very large db • 1989 ESO-LV 30.000 images • Work station • Sloan Digital Sky Survey– MicroSoft Research • AstroWISE – Euro VO

  3. VST

  4. OmegaCAM Detectors • Science array 1 x 1 degree, 32 CCDs • 15 mm pixels – 0.21 arcsec/pixel • Marconi (former EEV) 2k x 4k= 8 Mpix • 16k x 16k pixels = 256 Mpix • Auxiliary CCD’s – 4 CCDs • For guiding • Image analysis

  5. Paranal Mid 2005 + 3 year

  6. Lofar IBM- Blue Gene/L

  7. Handling of the data is non-trivial • Pipeline data reduction • Calibration • Image comparisons/combinations • source lists / catalogues • Visualization • Science can only be archive based Large Data Volume • Wide-field imaging = vast amounts of data • VST maps equivalent of Southern sky in 3 years 30 min exp, 300 nights/y. 100 Tbyte image data Tbytes source list data

  8. ASTRO-WISE Mission Virtual Survey System • Environment that provides systematic and controlled • Access to all raw and calibration data • Execution and modification image/calibration pipelines • Execution of source extraction algorithms- catalogues • Archiving or regenerate dynamically • federated to link different data centers • Dynamical archive continuously grows -- small or large science projects • generating and checking calibration data • sharing methods, scripts raw pixel data  pipelines/cal files  catalogues

  9. New technologies-paradigm • raw data centralized – on the fly reprocessing • sociology- project management • ++ • Python • parallel – IP - seti@home • user tunable pipelines • ++ db • 5 LS – 5 lines script

  10. development issues • Indexing Terabytes on the sky • Associating entries • World wide linking entries (referencing) - registries • Filtering • Visualisation - imaging • Visualisation -multidimensional data • VO world

  11. VST - Virtual Survey Telescope

  12. Tbyte source lists brains make the associations Link -lists as fast as possible

More Related