1 / 22

AstroGrid-D and (GA)VO

AstroGrid-D and (GA)VO. Overview. VObs/IVOA GAVO I + II Synergy with AstroGrid-D ?. Virtual Observatory I. Broad goal Make results of astronomical research, data and applications, more readily available to larger community, and create value-adding services. Facilitate results-

macy
Download Presentation

AstroGrid-D and (GA)VO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. AstroGrid-D and (GA)VO

  2. Overview • VObs/IVOA • GAVO I + II • Synergy with AstroGrid-D ?

  3. Virtual Observatory I • Broad goal • Make results of astronomical research, data and applications, more readily available to larger community, and create value-adding services. • Facilitate results- • communication • checking • (re)use • comparison • combination

  4. Combination: a multi-wavelength view of a galaxy merger X-Ray Radio Optical John Hibbard http://www.cv.nrao.edu/~jhibbard/n4038/n4038.html NASA/CXC/SAO/G. Fabbiano et al.

  5. the problem FIRST ROSAT GAIA 2MASS SDSS

  6. work on a solution FIRST ROSAT GAIA 2MASS SDSS

  7. Virtual Observatory II • Approach: • online availability of datasets and applications • standardized publication and discovery mechanisms • standardized description through common (meta-)data models • standardized selection mechanisms • standardized formats for transmitted data • value added services • introduce new technologies • find clever algorithms • Organized in International VO Alliance (IVOA)

  8. Some Results • Data formats: • VOTable • Data models for • Resource metadata (registry) • Space-time events: STC • Characterisation • Spectral data model • VOEvent • Protocols • Simple cone search (not a standard!) • Simple image access • simple spectral access • VOQL (ADQL/SkyNode) • Applications: • Aladin, VOPlot, TOPCAT, SpecView, Plastic

  9. Grid activities in VObs • IVOA Grid and web services working group (html) • Authentication • Universal Worker Service • VOSpace • Astro-RG in GGF (Nic Walton) • Euro VO DCA WP 5 • GAVO I (Gadget simulation, cluster finder)

  10. GAVO II • Since July 2007 • Organisation (5 FTEs) • AIP • ARI (PI) • MPE • Tübingen • TUM-Informatik

  11. GAVO (I + II) projects • Archives: • ROSAT All Sky Survey • cone search: photons, sources • SIAP: fields • RAVE web site • SSA on CDFS optical follow up spectroscopy • Heidelberg catalogues and GAVO archive • ROSAT pointed observations: SIAP • standardised approach to publish FITS images under SIAP • uses FITS metadata repository (SQLServer) • SQL based mapping and SIAP implementation • easily generalised to other datasets and protocols (SSA) • Data mining • Cross-matcher (also on Grid, TUM) • SED classifier • Cluster finder

  12. GAVO (I + II) projects ctd. • Grid • evaluation Globus • Gadget 2 on Globus MPI (AIP + MPE) • cluster finder • VOQL/SkyNode • VOQL tiger team (Benjamin Gufler) • HiSbase peer-to-peer approach • Mock catalogues for testing • Theory • IVOA: • Initialised Theory Interest Group (chair) • SNAP • Data models • Semantics • Millennium database • Virtual telescopes (planck, MoMaF2, Dolag)

  13. GAVO + AstroGrid-D I • Groups involved in both projects: AIP, ARI, MPE, TUM • Different kind of use cases: • VObs aims to enable external users to use resources • Heterogeneous world: Interoperate with resources outside of AstroGrid-D (but within IVOA standards)

  14. GAVO + AstroGrid-D II • Possible projects • Virtual telescopes • VOEvent and Robotic Telesopes ? • IVOA Registry vs Information Services • Input welcome ! • Definitely • SNAP implementation • OGSA-DAI access to Millennium DB

  15. SNAP using grid services • Simple Numerical Access Protocol • Project of IVOA theory interest group • Based on simulation data model (input welcome !) • Query interesting simulations • Select and retrieve subset • Implementation: SNAP on Millennium snapshots • Custom access code deployed near large datasets • Authenticated access • Standardised publication for use in Grid workflows (ProC? Streaming?) • Data staging and movement

  16. Globus container SNAP web service Grid Service getBox() C-module Information Service Millennium snaphots IS aware Workflow Engine

  17. Millennium website and OGSA-DAI • SQLServer database • halo/galaxy catalogues • density fields (environment queries) • efficient retrieval merger tree histories • spatial indexing • MyDB • TOMCAT web server • http://www.g-vo.org/MyMillennium • authentication using RDB • wget based access, IDL+R modules • Synchronous queries • JDBC, streaming • 7 min time limit • I/O problems

  18. Why Grid interesting? • Need • Asynchronous access • Queuing • Improve result management, data delivery • Bulk uploading into MyDB • More generic authentication (X.509) • Will try CAS jobs (SDSS/JHU) • Investigate OGSA-DAI • Map portal to OGSA-DAI functionality • Monitoring ? Logging ? Performance ?

  19. Conclusion • VObs and Grid complementary • Plenty points of contact • Useful synergies easy to find

More Related