1 / 18

Japanese Virtual Observatory and NaReGi

Japanese Virtual Observatory and NaReGi. Masatoshi Ohishi / NAOJ, Sokendai & NII 大石雅寿 / 　　国立天文台 , 総合研究大学院大学 & 国立情報学研究所 masatoshi.ohishi@nao.ac.jp. Supported by. JSPS, Core to Core Program MEXT, Kakenhi NII, CSI project NAOJ. Too hard to collect and analyze whole data.

hanh
Download Presentation

Japanese Virtual Observatory and NaReGi

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Japanese Virtual Observatory and NaReGi Masatoshi Ohishi / NAOJ, Sokendai & NII 大石雅寿 / 　　国立天文台, 総合研究大学院大学 &国立情報学研究所 masatoshi.ohishi@nao.ac.jp Astro-RG, OGF20

  2. Supported by • JSPS, Core to Core Program • MEXT, Kakenhi • NII, CSI project • NAOJ Astro-RG, OGF20

  3. Too hard to collect and analyze whole data. Need Cat’s help Data Rate Nobeyam Radio Obs. ~ 1 TB/yr SUBARU telescope ~ 20 TB/yr ALMA ~ 1 PB/yr Even for educational use Accelerate astronomical research, and sufficient time for research itself !! Virtual Observatory Accessible from anywhere at any time Astro-RG, OGF20

  4. Overview of the JVO Portal Service LDAP 解析 解析 解析 Analysis Servers Auth. Grid System User Request SDSS QSO JVO SkyNode 1.0 Invoke Subaru Invoke MDS Portal … 2MASS Service Discovery User Storage Data Service Web Service Invoke HTTPGet S. Reg. FTP SIAP/SSAP LDAP Other VOs P. Reg. Metadata Harvesting P. Reg. SkyNode 0.7.4 Registry Astro-RG, OGF20

  5. Log(F_IR) MAG_B Astro-RG, OGF20

  6. Spectral Data from Subaru • queries • display • Baseline estimate • Line detection • VOSpec High Dispersion Spectrometer Astro-RG, OGF20

  7. Interconnected VO Data services in the World Canada VO More than 600 data resources are available Astro-RG, OGF20

  8. Improvement of Work Flow system Items in FY2006 • Improvement of WFDL • Shorten the volume of DL • Array definition • Awk-like description (loop description in a single line) • and so on • Built-in functions • Available to register and use built-in functions • Status and Log system WF Editor Execution monitor Astro-RG, OGF20

  9. Overview of the JVO Portal Service LDAP 解析 解析 解析 Analysis Servers Auth. Grid System User Request SDSS QSO JVO SkyNode 1.0 Invoke Subaru Invoke MDS Portal … 2MASS Service Discovery User Storage Data Service Web Service Invoke HTTPGet S. Reg. FTP SIAP/SSAP LDAP Other VOs P. Reg. Metadata Harvesting P. Reg. SkyNode 0.7.4 Registry Astro-RG, OGF20

  10. Data Storage Service Data Search Service MDS Server Data Analysis Service Subaru Grid Pipeline Arch. 1. search an available server Client query status 5. result URL 3. query a location of data report status 2. submit a job 6. Submit data transfer job 7. retrieve the result 4. get data Astro-RG, OGF20

  11. Grid Service on VO • Subaru data reduction pipeline system • Web service based GRID • Generates calibration data (Super-Flat) for all the SuprimeCam data in a week • On-the-fly data reduction with the pre-prepared Super-Flat • Users can access to the data reduced with the most recent algorithm • Also support the older version of pipeline • Backend computing system of the JVO • catalog generation • photo-z calculation • Image arithmetic • … Astro-RG, OGF20

  12. Reduction 10s(Bias+Flat+Distortion+ Astrometory) • Transfer 30s Data Reduction: ~24 hours  ~1 hour Astro-RG, OGF20

  13. Study on Environment around QSOs HighConcentrationLow PresentPast Astro-RG, OGF20

  14. NAREGI Site Middleware CA Research ナノ分野 実証・評価 分子研 Dev.（　　） ナノ分野 実証・評価 分子研 βver. V1.0 V2.0 Nano Proof of al.Concept Eval. IMS • International • Collaboration • - EGEE • - UNIGRIDS • Teragrid • GGF etc. Operaontional Collaborati NII Collaborative Operation Center R&D Collaboration Cyber-Science Infrastructure（ＣＳＩ） （IT Infra. for Academic Research and Education) Nano Proof, Eval. IMS Cyber Science Infrastructure toward Petascale Computing (planned 2006-2011) Joint Project （Bio） Osaka-U R&D Collaboration Joint Project AIST Feedback R&D Collaboration Delivery Delivery Operation/ Maintenance （UPKI,CA） Contents Operation/ Maintenance （Middleware） Networking Delivery Feedback Delivyer Peta-scale System VO Feedback Core Site Project-oriented VO Project- Oriented VO Customization Operation/Maintenance Industrial Projects Univ./National Supercomputing VO Domain Specific VOs Domain Specific VOs IMS,AIST,KEK,NAO,etc. Networking Infrastructure (Super-SINET/SINET3） Astro-RG, OGF20 Note: names of VO are tentative）

  15. Introduction of the NaReGi middleware into JVO • NaReGi middleware version b1.0.2 • Trial introduction into the Subaru Grid pipeline • A part of middleware deployment program by the NII • To evaluate how easy it is to use the middleware • To find which components may be used for Virtual Observatories • SSO, Apps interface, and so on Astro-RG, OGF20

  16. ・Registration of UserApplications ・Generation of WF ・Issue CAs ・Keep proxy certif. ・Find Computation Resources ・Job Scheduling ・Monitor Job Execution・Display Information ・Computation Node ・Job monitor at each site ・Job monitor at each node Data Flow NAREGI Grid environment Astro-RG, OGF20

  17. Requests to Improve • Items to be improved toward version 1.0 • Make it easier to install • Make it much faster to install • Need to support OSs other than RHEL • and so on • These requests were reflected to the modified road map of NaReGi. Astro-RG, OGF20

  18. Good Findings • Good Graphical WF builder • Plan to import to the JVO system • Maybe referred to by the IVOA Astro-RG, OGF20

More Related