Virtual Observatories Integration of Astronomical Data & Analyses tools

1. Virtual ObservatoriesIntegration of Astronomical Data & Analyses tools Masatoshi Ohishi / NAOJ & Sokendai 大石雅寿 / 国立天文台 & 総合研究大学院大学 masatoshi.ohishi@nao.ac.jp GGF 17 Data Integration WS

2. Nobeyama 45m Data Resources in NAOJ Subaru Subaru 8.2m Optical-Infrared Telescope Kiso 105cm Schmidt Camera Okayama 188cm Optical Telescope Nobeyama 45m Radio Telescope Nobeyama Millimeter Array Nobeyama Radioheliograph VSOP VERA ALMA GGF 17 Data Integration WS

3. Too hard to collect and analyze whole data. Need Cat’s help Data Rate Nobeyam Radio Obs. ~ 1 TB/yr SUBARU telescope ~ 20 TB/yr ALMA ~ 1 PB/yr Even for educational use Accelerate astronomical research, and sufficient time for research itself !! Virtual Observatory Accessible from anywhere at any time GGF 17 Data Integration WS

4. VO Projects in the world • 17 countries and a region • International Virtual Observatory Alliance (IVOA)Standards to interoperate VOs http://www.ivoa.net/ GGF 17 Data Integration WS

5. GGF 17 Data Integration WS

6. Standardization in IVOA • Query Language to Federated DBs (VOQL) • Access resource meta-data based on the OAI-PMH • Access Images, Spectra, Catalogues, etc：SkyNode, SIAP, SSAP, STC, etc. • Unified Attribute Names：UCD (Unified Contents Descriptions) • Output format：VOTable (XML) • and so on GGF 17 Data Integration WS

7. IVOA Interoperability WS in Kyoto • 2005 May • 90+ people • About 20 countries including China, Korea and Taiwan • Supported by JSPS GGF 17 Data Integration WS

8. Web Services Web Services Input Queries and Analysis Parameters Resource Meta-data Web Services Controller 　・parser 　・scheduler 　・Service caller User Interface ・Query Editor ・VOTable viewer ・DB queries ・Plotter ・etc User Web Services JVO Portal Server Schematic diagram of VOs SIAP/SSAP/SkyNode US/CAN SIAP/SSAP/SkyNode Europe GGF 17 Data Integration WS

9. Exchange of Meta Data:OAI-PMH Searchable Registry Publishing Registry Publishing Registry Query Services Access to various services Data Service Analysis Service Virtual Observatory Client GGF 17 Data Integration WS

10. Successful Interoperations • Accesses from / to other VOs in Europe and US have been available since Dec 2004 • Publishing & Searchable Registries • 140+ resources are accessible as of today GGF 17 Data Integration WS

11. Interconnected VOs in the World Canada VO GGF 17 Data Integration WS

12. Integration of standard protocols GGF 17 Data Integration WS

13. Workflow Description Language Based on BPEL4WS • Variable definition • Controls (Loop, Condition) • Parallel execution • Invoke external services • Invoke built-in Java Classes GGF 17 Data Integration WS

14. Management of Multiple Servers • Data Analysis services under JVO • SExtractor (Image → Catalog) • HyperZ (Catalog → photometric redshift) • In operation on multiple servers → Monitor and Discovery Service (MDS) server JVO Portal MDS Server Analysis Servers # of Jobs CPU load Job status Service Request Execute Available Server Info Confirm Job Completion Analysis Server Management Data Job Completion Info Job submission Client Results Parallel Executions on Multiple Servers are available GGF 17 Data Integration WS

15. GGF 17 Data Integration WS

16. Discovery of a Brown Dwarf：SDSS/2MASS discoveries like this much easier if databases jointly queryable GGF 17 Data Integration WS

17. Detection of MANY Type II Quasars GGF 17 Data Integration WS

18. International Endorsements • IAU XXVth GA Res. (2003 Jul.) • OECD Rec. (‘04 Aug) • place archives that may be accessible via internet • provide adequate funding as long-term issues GGF 17 Data Integration WS

19. Reference URLs JVO – http://jvo.nao.ac.jp/index-e.html IVOA – http://www.ivoa.net/ there are links to other VO projects in the world GGF 17 Data Integration WS