220 likes | 309 Views
AstroGrid-D and (GA)VO. Overview. VObs/IVOA GAVO I + II Synergy with AstroGrid-D ?. Virtual Observatory I. Broad goal Make results of astronomical research, data and applications, more readily available to larger community, and create value-adding services. Facilitate results-
E N D
Overview • VObs/IVOA • GAVO I + II • Synergy with AstroGrid-D ?
Virtual Observatory I • Broad goal • Make results of astronomical research, data and applications, more readily available to larger community, and create value-adding services. • Facilitate results- • communication • checking • (re)use • comparison • combination
Combination: a multi-wavelength view of a galaxy merger X-Ray Radio Optical John Hibbard http://www.cv.nrao.edu/~jhibbard/n4038/n4038.html NASA/CXC/SAO/G. Fabbiano et al.
the problem FIRST ROSAT GAIA 2MASS SDSS
work on a solution FIRST ROSAT GAIA 2MASS SDSS
Virtual Observatory II • Approach: • online availability of datasets and applications • standardized publication and discovery mechanisms • standardized description through common (meta-)data models • standardized selection mechanisms • standardized formats for transmitted data • value added services • introduce new technologies • find clever algorithms • Organized in International VO Alliance (IVOA)
Some Results • Data formats: • VOTable • Data models for • Resource metadata (registry) • Space-time events: STC • Characterisation • Spectral data model • VOEvent • Protocols • Simple cone search (not a standard!) • Simple image access • simple spectral access • VOQL (ADQL/SkyNode) • Applications: • Aladin, VOPlot, TOPCAT, SpecView, Plastic
Grid activities in VObs • IVOA Grid and web services working group (html) • Authentication • Universal Worker Service • VOSpace • Astro-RG in GGF (Nic Walton) • Euro VO DCA WP 5 • GAVO I (Gadget simulation, cluster finder)
GAVO II • Since July 2007 • Organisation (5 FTEs) • AIP • ARI (PI) • MPE • Tübingen • TUM-Informatik
GAVO (I + II) projects • Archives: • ROSAT All Sky Survey • cone search: photons, sources • SIAP: fields • RAVE web site • SSA on CDFS optical follow up spectroscopy • Heidelberg catalogues and GAVO archive • ROSAT pointed observations: SIAP • standardised approach to publish FITS images under SIAP • uses FITS metadata repository (SQLServer) • SQL based mapping and SIAP implementation • easily generalised to other datasets and protocols (SSA) • Data mining • Cross-matcher (also on Grid, TUM) • SED classifier • Cluster finder
GAVO (I + II) projects ctd. • Grid • evaluation Globus • Gadget 2 on Globus MPI (AIP + MPE) • cluster finder • VOQL/SkyNode • VOQL tiger team (Benjamin Gufler) • HiSbase peer-to-peer approach • Mock catalogues for testing • Theory • IVOA: • Initialised Theory Interest Group (chair) • SNAP • Data models • Semantics • Millennium database • Virtual telescopes (planck, MoMaF2, Dolag)
GAVO + AstroGrid-D I • Groups involved in both projects: AIP, ARI, MPE, TUM • Different kind of use cases: • VObs aims to enable external users to use resources • Heterogeneous world: Interoperate with resources outside of AstroGrid-D (but within IVOA standards)
GAVO + AstroGrid-D II • Possible projects • Virtual telescopes • VOEvent and Robotic Telesopes ? • IVOA Registry vs Information Services • Input welcome ! • Definitely • SNAP implementation • OGSA-DAI access to Millennium DB
SNAP using grid services • Simple Numerical Access Protocol • Project of IVOA theory interest group • Based on simulation data model (input welcome !) • Query interesting simulations • Select and retrieve subset • Implementation: SNAP on Millennium snapshots • Custom access code deployed near large datasets • Authenticated access • Standardised publication for use in Grid workflows (ProC? Streaming?) • Data staging and movement
Globus container SNAP web service Grid Service getBox() C-module Information Service Millennium snaphots IS aware Workflow Engine
Millennium website and OGSA-DAI • SQLServer database • halo/galaxy catalogues • density fields (environment queries) • efficient retrieval merger tree histories • spatial indexing • MyDB • TOMCAT web server • http://www.g-vo.org/MyMillennium • authentication using RDB • wget based access, IDL+R modules • Synchronous queries • JDBC, streaming • 7 min time limit • I/O problems
Why Grid interesting? • Need • Asynchronous access • Queuing • Improve result management, data delivery • Bulk uploading into MyDB • More generic authentication (X.509) • Will try CAS jobs (SDSS/JHU) • Investigate OGSA-DAI • Map portal to OGSA-DAI functionality • Monitoring ? Logging ? Performance ?
Conclusion • VObs and Grid complementary • Plenty points of contact • Useful synergies easy to find