1 / 34

GAVO – after one year

GAVO – after one year. H.-M. Adorf & the GAVO team. GAVO’s Pillars. Publication and federation of datasets including theoretical ones Spatial matching & classification & visualization (NGSE) Grid computing. The GAVO Team. PI: Wolfgang Voges, MPE, Garching

samuru
Download Presentation

GAVO – after one year

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GAVO – after one year H.-M. Adorf & the GAVO team

  2. GAVO’s Pillars • Publication and federation of datasets • including theoretical ones • Spatial matching & classification & visualization (NGSE) • Grid computing

  3. The GAVO Team • PI: Wolfgang Voges, MPE, Garching • CoI: Matthias Steinmetz, AIP, Potsdam • Hans-Martin Adorf, MPE • Harry Enke, AIP • Gerard Lemson, MPE

  4. Collaborations • MPE, Garching (Peter Schuecker) • AIP Potsdam • Canadian Virtual Obs. (CVO), Victoria • Universitaetssternw. Muenchen (USM) • MPA, Garching (Planck, …)

  5. GAVO Work Areas • Publication of ROSAT datasets • REST-based SCS service (HTTP GET in; XML, CSV, HTML out) • SOAP-based SCS service • MCMCS Download Manager • Fuzzy spatial matcher • Grid-based detection of galaxy clusters • ROSAT matcher/classifier service

  6. ROSAT All-Sky Survey (RASS) • BSC, FSC & Photons • VO-compatibility: • Input: Simple cone search • Output: VOTable, … • New features • Exposure times • Galactic & Cartesian coordinates • Healpix indices

  7. SCS

  8. Result

  9. VOTable

  10. MCMCS Download Manager • Tool … • … accesses registry at JHU • User … • … selects up to 70 distributed catalogues • … specifies one or more sky-locations • Tool … • … queries remote catalogues • … retrieves datasets (VOTables) for further processing

  11. MCMCS Download Manager

  12. MCMCS Download Manager

  13. Workflow

  14. Fuzzy spatial matcher • Essential for data mining • Prototype features • Performs “fuzzy” match between pairs of source lists from different catalogues • Computes probability of real match based on astrometric uncertainties • Moving matcher into production use • Currently exported to Canadian Virtual Observatory • Feeding matches to ClassX classifier • Long-term goal: assemble an SED

  15. Fuzzy spatial matcher (ctd)

  16. Grid computing • What is Grid-computing? • Globus Toolkit, SGE, EJBs • WebServices • Detection of galaxy clusters • using RASS photons, SDSS • RASS source classification • using RASS B/FSC, SUMSS, NVSS, USNO

  17. Workflow

  18. Galaxy-cluster detection • Search for galaxy clusters in heterogeneous databases • RASS photons • SDSS • Software • FORTRAN 90 code (data analysis) • Perl scripts (data/grid management) • Globus Toolkit

  19. Galaxy-cluster detection • Components • Setup script • Sets up the directory structure • Distributes the software across the grid • Execution script • Triggers the parallel execution on the compute nodes • Data collection script • Retrieves the results from the compute nodes

  20. GAVO Mini-GRID

  21. Status • Perl scripts • Upgrading the RASS Photon DB • Soon integrate the SDSS mirror copy

  22. RASS-source classifier • ClassX: international collaboration • T.A. McGlynn, A.A. Suchkov, E.L. Winter, R.J. Hanisch, R.L. White, F. Ochsenbein, S. Derriere, W. Voges, M.F. Corcoran • Requires data from several sky-surveys • X-ray: ROSAT BSC+FSC • Optical: USNO, (SDSS) • Infrared: (2MASS) • Radio: FIRST, NVSS, SUMSS • Distributed multi-wavelength VO-application

  23. Data Flow

  24. PoseQuery

  25. DisplayQueryResult

  26. DisplayMatchResult

  27. The matching problem

  28. DisplayXMatchResult

  29. DisplayClassXResult

  30. RASS-source classifier • State & session management • Using Java Servlet session mechanism • Internal abstract state machine • Strong points • End-to-end VO-application • Works with lists of objects / sky-coordinates • Accesses several distributed databases • Uses deterministic matcher (at Vizier and SDSS) • Uses probabilistic matcher (at GAVO) • Uses data analysis service (at NASA)

  31. RASS-source classifier • Future work • Use IVOA-standards or protocols • VOTable • WSDL, SOAP-based Web Services • Add graphics • Multi-threaded • Modularize, generalize and make S/W configurable

  32. RASS-source classifier • Open questions • Is an HTML form-based GUI sufficiently powerful to control a complex grid application? • What are the user expectations wrt the workflow? • Is there a standard workflow that one could use / agree upon?

  33. Conclusion • GAVO is a small, but ambitious project • Two Grid applications • Detection of galaxy clusters • Globus Toolkit • Classification of ROSAT sources • Based on WebServices

  34. References • GAVO Mid-Term Report, 90 pages, http://www.g-vo.org (soon) • Detection of X-ray Clusters of Galaxies by Matching RASS Photons and SDSS Galaxies within GAVO, P. Schuecker, H. Boehringer, W. Voges, A&A (submitted) • Automated classification of ROSAT sources using heterogeneous multiwavelength catalogs, T.A. McGlynn et al., ApJ (submitted)

More Related