1 / 21

Astro-WISE paradigm for Citizen eScience

Astro-WISE paradigm for Citizen eScience. Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium. Outline. What is Astro-WISE?: An information accumulator for eScience Massive datasets Data centric Federated Paradigm for Citizen eScience?

tuyen
Download Presentation

Astro-WISE paradigm for Citizen eScience

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Astro-WISEparadigmforCitizeneScience Gijs Verdoes Kleijn Edwin Valentijn Marjolein Cuppen for the Astro-WISE consortium

  2. Outline • What is Astro-WISE?: • An information accumulator for eScience • Massive datasets • Data centric • Federated • Paradigm for Citizen eScience? • Astronomers and public collaborating in one system

  3. ESO Public Imaging Surveys VIRCAM@VISTA 0.6 sq.deg. NIR camera 16 2kx2k detectors 0.35” pixels Science verification phase OmegaCAM @VST 1sq.deg. Opt. camera 32 2kx4k detectors 0.21” pixels Commissioning mid 2010 KIDS~500 nights 1500 sq.deg. u g r i VIKING~250nights z, Y, J, H, K UKIDSS workshop 2007

  4. Paranal Monthly Data Rates 2007 statistics • All Current Paranal • Instruments 4% (433.2 GB) • OmegaCAM 24% (~2500 GB) • VIRCAM 72% • (~7500 GB) • Courtesy Mark Neeser

  5. Science drivers Needles in haystacks high-z QSOs (6.4<z<7.2) Extreme Galactic White Dwarfs (Rare) AGNs The unanticipated Haystacks: Dark matter distribution: weak lensing Dark energy Evolution of galaxy clusters Unexpected Needles are easier than haystacks

  6. Dissemminating results Calibration Archiving (raw+final) Quality control User tuned research Optimize scientific return Wide-field Imaging Integrated Information system Survey monitoring • Facilitate (un)foreseen uses of calibrated and raw Tera/Petabyte data sets by global pools of collaborators and resources • This requires enabling changes at any time in: • Physical parameters (e.g., instrument/atmosphere) • Improved algorithms • Improved insight in 1. or 2. • Requires a single integrated information system

  7. Astro-WISE (/eScience) boundary condition • Pool via federation into a single system • Distributed science teams • Distributed storage, compute and database resources • Peer-to-peer network

  8. TARGET diagram The philosophy that drives how we store information • Data model in object model • OOP (python), inheritance, attribute persistency • Full backwards-chaining of dependencies

  9. Extreme data lineage

  10. Astro-WISE information system data centric architecture • All data beyond pixel data is Metadata • all pixel data <–>data servers • all Metadata <–> database • all I/O to database • Compute clusters / GRIDs • Graphical User Interfaces (Web-services) • All components scalable

  11. Astro-WISE - Virtual Survey Telescope Pipeline Methods/Algorithms In on-line repository Python (wrapped) CPUs • DATABASE • LINKS • METADATA images • CATALOGS • Contains “ALL input/output” • DATA SERVERS: • Images: • Calibration & science • Raw & final OmegaCEN review 2008

  12. www.astro-wise.org

  13. + MegaCAM, LBC, ISAAC, LOFAR, SDSS DR7, 2MASS, USNO…

  14. Web servicesTarget processor

  15. Quality view

  16. Benefits from integrated dynamic database relevant for Citizen eScience ( ) • Both final and raw products accessible • GUI can be fully web services no local installation needed to use it • can be installed everywhere with off-the-shelf hardware • Objects are linked, all bits are traced: • on-the fly re-processing • Annotation record building • Built–in workflow • Easy publishing via Virtual Observatory and webservices • Own compute GRID operational • A federated integrated-system: • Naturally serves global collaborative projects • Scalable: image server/database/compute GRID resources can grow via federation • Mydb environment operational for individual research • Quick scripting: many tasks are “5 Line Scripts” • Fully user tunable – own provided algorithms/scripts allowed • Python: existing software can be wrapped (implemented for Sextractor, swarp, being implemented for GALPHOT, GALFIT)

  17. (Citizen) eScience • Discovery of the exotic: • gravitational lenses, mergers,… • SNe, • transients, • Satellites • asteroids • Survey Quality Control • -visual inspection KIDS: 3yr manpower. -object masking-astrometry

  18. (Citizen) eScience • Open-up massive datasets to the public • Playing -> exploring -> science • A single environment for public and scientist • Feeling at home in the Universe on spaceship Earth

  19. (Citizen) eScience www.astro-wise.org www.rug.nl/TarGet • Open-up massive datasets to the public • Continum: playing -> exploring -> science • A single environment for public and scientist • Feeling at home in the Universe on spaceship Earth

  20. www.rug.nl/TarGet TASK24 2009-13 32M

More Related