330 likes | 519 Views
Current Status of Japanese Virtual Observatory. M asatoshi Ohishi N ational Astronomical Observatory of Japan and Sokendai masatoshi.ohishi@nao.ac.jp. NAOJ Y. Mizumoto N. Yasuda Y. Shirasaki M. Tanaka S. Honda Ochanomizu U. Y. Masunaga Osaka U. S. Shimojo & his team
E N D
Current Status of Japanese Virtual Observatory Masatoshi Ohishi National Astronomical Observatory of Japan and Sokendai masatoshi.ohishi@nao.ac.jp CVO Meeting in Beijing
NAOJ Y. Mizumoto N. Yasuda Y. Shirasaki M. Tanaka S. Honda Ochanomizu U. Y. Masunaga Osaka U. S. Shimojo & his team Titech S. Matsuoka & his team Fujitsu Ltd. K. Monzen K. Kawarai Y. Ishihara H. Yanaka Y. Yamaguchi M. Ishida N. Saito K. Abe J. Tsutsumi H. Nakamoto Y. Morita Collaborators Ken Miura CVO Meeting in Beijing
Large Telescopes of NAOJ • Subaru (optical & Infrared) @ Hawaii • Nobeyama (Radio) single dish : f45-m interferometer : 6 x f10-m solar interferometer : 84 x f75-cm • HALCA – in orbit f8-m CVO Meeting in Beijing
Subaru CVO Meeting in Beijing
Subaru Telescope CVO Meeting in Beijing
45m Radio Telescope CVO Meeting in Beijing
VSOP CVO Meeting in Beijing
JAXA is going to join JVO !! Infrared Satellite by JAXA Launch : 2005 ? CVO Meeting in Beijing
Data Productivity • Nobeyama Radio :~1TB/yr • Subaru@Hawaii :~20TB/yr • ALMA(planned) :~PB/yr Flood of excellent data (survey data) Digitized & Archived CVO Meeting in Beijing
10 Gbps CVO Meeting in Beijing
HPC + High Speed NETWORK +GRID Technology → it is possible to federate multi-wavelength-DBs and computing facilities for data analyses → Virtual Observatory CVO Meeting in Beijing
JVO prototype : Ver. 1 • Establish seamless access to federated DBs by using the Grid technology • Define JVO Query Language, and implement its parser • Test environment is in a closed subnet CVO Meeting in Beijing
Monitor Window: Refreshed automatically in every 15 seconds Dynamical creation of a workflow CVO Meeting in Beijing
Sample Outputs CVO Meeting in Beijing
Hypertext contents JVO Client Netscape Communicator Java2 Plugin JVO Client (applet) Redhat Linux 2Mass DataBase JVO Prototype System Architecture Redhat Linux JVO Service Gb Ether Solaris8 (Possible at Linux) JVO Controller GSDL UDDI Maintenance Tool UDDI Registory / Servlet Engine Globus Toolkit (Server) Java2SE 1.4 Java2SE 1.4 JVO Service (X match) Apache Tomcat Maintenance Tool UDDI4J soapuddi SQL library JVO Service (select) Apache SOAP • register • update • delete JDBC ① Applet DownLoad ③ Find Service ② Request Observation JVO Controller DB Service Image Data (copy) DB Service Java2SE 1.4 PostgreSQL (DBMS) PostgreSQL JVO Server Monitoring Image Data 2Mass DB UDDI4J SUBARU SupCam z-band UDDI Data • get & parse GSDL • pre condition check • execute Service • post condition check SUBARU DataBase Redhat Linux JVO Service ⑦ issue SQL ⑤ execute Service ③ get GSDL GSDL GSDL (copy) ④’ Get GSDL by GridFTP ⑤’ execute Service Check status Globus Toolkit (Client) Globus Toolkit (Server) Internet ⑥’ spawn Service ④ Get GSDL by GridFTP JVO Service (image) AVO JVO Service JVO Service (X match) SUBARU DataBase Globus Toolkit Globus Toolkit (Server) GridFTP GSDL SQL library JVO Service (select) NVO ⑥ spawn Service JVO Service (select) JVO Service (count) SQL library SQL library JVO Service (image) JVO Service (X match) Globus Toolkit SQL library JVO Service (count) ⑦’ issue SQL Image Data (copy) DB Service Image Data Copy imate data by GridFTP Image Data (copy) ORACLE Copy imate data by GridFTP • The following free software is included by globus toolkit. • OpenSSL (Secure Socket Library) • OpenLDAP (LDAP Server) • wu-ftpd (ftp server) SUBARU SupCam i-band CVO Meeting in Beijing Image Data Free Software In House Software Commercial Software Function
JVO Query Language CVO Meeting in Beijing
SkyQL & ADQL • JVOQL has been adopted as one of the basis for SkyQL (standard query language in IVOA) • XML description of SkyQL = ADQL Astronomical Data Query Language CVO Meeting in Beijing
Serious Issue Q) GT2 has too large overhead before starting actual jobs !! They are several seconds. A) For batch jobs, such as database accesses, the overhead could be negligible. However users can never wait for several second for interactive data analyses. Request) Overheads must be < 0.1 seconds excluding the network delays. CVO Meeting in Beijing
Partially solved !! • Introduction of NMI -- authentication module : binary • Analysis of the source codes of GTK2 -- polling interval : 30 sec -> 3 sec • Elapsed time was halved ! But …, still very slow. CVO Meeting in Beijing
Improvement of U.I. Need to know about SQL to use JVOQL → An editor to create JVOQL from GUI Edittable on screen →more flexibility for advanced users CVO Meeting in Beijing
Search for Gravitational Lensescaused (?) by Cosmic Strings • SXDS data observed by Subaru • Query results were obtained less than 5 min., displaying SEDs • It has been proven that VO can accelerate researches. CVO Meeting in Beijing
Cosmic Strings? • Theoretical origin of the elementary particles which existed (?) at t ~ 10-35 s,T ~ 1015 GeV • Not a POINT, has its SIZE • Width < 10-22m, Length ~ size of the Universe. • Mass of 10km string ~ the Earth CVO Meeting in Beijing
Gravitational Lens • A phenomenon that the space-time is distorted by a huge mass object, and multiple images of another object behind the massive object are observed around it. CVO Meeting in Beijing
Development of Prototype2 For preparation of Operational System • User registration : single sign-on • User area over Firewall : GSI-SFS • Adoption of OGSA • Implementation of several analysis tools CVO Meeting in Beijing
Registry セキュリティ 管理 資源管理 データベースサーバ2 データ検索処理 PostgreSQL WSDL 画像管理 DB データ数count クロスマッチ処理 OGSA-DAI OGSA-DAI OGSA-DAI Globus Toolkit V3 Globus Toolkit V3 Globus Toolkit V3 SUBARU SupCam i-band 解析処理 検索依頼 Linux 結果サーバ Local disk Local disk Local disk 利用者 データ GT3 利用者 データ 利用者 データ 利用者 データ GT3 GT3 GT3 GSI-SFS GSI-SFS GSI-SFS GSI-SFS データベースサーバ1 データ検索処理 ORACLE 分散情報管理 GWSDL OGSA -DAI 画像管理 DB データ数count Gb Ether Gb Ether 2MASS 利用者操作画面 DAISGR Globus Tk Linux ポータルサーバ 統合検索指示 統 合 検 索 実 行 制 御 機 能 ポータルサーブレット 登録情報検索機能 利用者管理機能 状況表示 条件指定画面 分散処理制御 解析サーバ 統合検索状況モニター ・DAISGR検索 ・GWDSL解釈 ・準備、実行、結果確認 解析処理 Linux データ保存 検索状況モニター画面 Web Server データベースサーバ N 統合検索結果表示機能 Globus Toolkit V3 データ検索処理 PostgreSQL WSDL 画像管理 DB スケジュール 作成 Ⅱ スケジュール作成 Ⅰ データ数count 解析指示 FW クロスマッチ処理 Globus Toolkit V3 検索結果画面 JVO-QL翻訳サーバ SUBARU SupCam z-band Webブラウザ Solaris8 解析処理 Windows, Solaris8, Linux 検索依頼 CVO Meeting in Beijing Solaris8
Road Map 2003Prototype 2 →development of components for operation 2004start to develop operational system late 2004 ?? trial use 2005-2006 trial use & upgrade 2007prepare for partial operation of ALMA CVO Meeting in Beijing
ALMA in Chile (sub-mm wave) CVO Meeting in Beijing