International Data Acquisition for Disaster Prevention and Data Access Technology

1. International Data Acquisition for Disaster Prevention and Data Access Technology Hyunseung Choo Sungkyunkwan University http://monet.skku.ac.krchoo@skku.ac.kr

2. Contents • Introduction • Earth System • weather prediction, earthquakes, and environments • From Networking to Grid Computing • ET over Grid • The Proposal • Importance • Current status • Proposed approach • Final goals • Members and organizations • Conclusion

3. Technology for the Weather Forecasting • Observations • Data Collection • Data Analysis • Weather Forecasting

4. Nature Global Infrastructure for Earth System

5. From Networking to Grid Computing (1/2) • Exponential Growth of Network Technology • Network vs. Computer Performance • Computer speed doubles every 18 months • Network speed doubles every 9 months • Difference = order of magnitude per 5 years • 1986 to 2000 • Computers: x 500 • Networks: x 340,000 • 2001 to 2010 • Computers: x 60 • Networks: x 4000

6. Supercomputer Scientific Research Instrument Problem solving Experts Large Scale Data From Networking to Grid Computing (2/2) • Definition of GRID Research infrastructure for dynamic collecting and sharing research resources connected by high-speed networks GRID

7. Grid Based Resource Integration • Challenge to huge problems that require massive capability over limited resources at multiple sites • Grid Computing • Networking of locally distributed high performance (HP) resources • HP computers, storages, experimental facilities, etc. • IT infrastructure to group systems as a single system • Classified into Access Grid, Computational Grid and Data Grid • Core applications based on Grid • “IT + Application” : Environment Technology (ET), Bio Technology (BT), Nano Technology (NT), Space Technology (ST), Cultural Technology (CT), etc. • Investigated HPCN since late 1980 in US, JP, EU • Concentrate to Grid Technology since 2000

8. Pan-Korean Distributed HPC Resources • Access Grid System • Supercomputers • Experimental Facilities • Computers Chuncheon Seoul Incheon Suwon Chonan Chongju Daejeon Pohang Jeonju Daegu Ulsan Chang- won Kwangju Pusan • Databases • Mass Storage • Visualization • Environment Cheju • High Speed Networks

9. Importance of R&D Project • KOREN based distributed Grid Computing environments • Overcome limitations of the meteorology area through Grid • Limitations on computing, networking and data storing • Solve earlier problems based on disaster prevention data • Data format for providers ⇒ Data format for consumers • Offer common collaborative environments to weather experts • Substitute clusters for supercomputers • Disaster prevention system by forecasting natural disasters • RT data transmission, high-speed producing and processing • Parallel technology for numerical models on natural disasters • Low-cost RT disaster prediction • Severe weather prediction, environments, East Sea earthquake tsunami (a tidal wave) • Currently depend on GTS in the Japan Meteorological Administration

10. Final Goals on R&D Project • KOREN based Grid system for international disaster prevention • KOREN/APII based international joint production of disaster related prevention data • development of high speed data access and process system model • parallelization of current SWs and sharing international disaster prevention resources KMA SKKU SWU PKNU NIED (JP) UCLA (US) Nagoya U. (JP)

11. Key Elements on R&D Project • Current year • Sharing data for weather prediction with Japan (APII, Nagoya Univ.) • Sharing East Sea seismological information (National Research Institute for Earth Science and Disaster Prevention of Japan) • Numerical models for disaster preventions in Grid environments • Access Grid for multicasting based on KOREN • Current year + 1 • Sharing and verifying weather data (UCLA) • RT transmission of disaster prevention data • Development of applications for disaster preventions (MPICH-G2) • Current year + 2 • Use of Data Grid for massive data transmission • Use of international core technology for disaster preventions (KOREN, APII)

12. Data for Disaster Preventions • International data collection for weather prediction, climates, earthquakes and environments for disaster predictions • RT and distributed collection of weather prediction, climates, earthquakes and environments over the entire earth • Access Grid • Collaborating organizations for international data sharing • Based on APII-testbed • Disaster prediction modeling based on the data collection • RT locating/allocating distributed computational resources • Computational Grid • Data acquisition for analyzing and forecasting global weather prediction • RT delivery systems for disaster predictions information • KOREN + Grid technology => constructing IT infrastructure

13. Collaborative working environment for producing disaster prevention data (PKNU(KR), Nagoya Univ.(JP)) Seismological observation network between Korea and Japan (KMA(KR), NIED(JP)) Production of data for weather prediction by using Grid (PKNU(KR), UCLA(US)) Members and Organizations • Communication infrastructure for disaster prevention • (SKKU(KR), SWU(KR)) • Protocols for monitoring seismic • activity • Virtual collaboration environment KOREN APII-Testbed KOREN & APII-Testbed Based Virtual Collaboration Environment For Disaster Preventions

14. PKNU (KR) UCLA (US) Nagoya Univ. (JP) NIED (JP) SKKU (KR) SWU (KR) Weekly Seminar Invited Talks Access Grid Demo 1st Report Approaches (2003) KMA (KR) RT data exchange for weather prediction Analysis & sharing of massive seismological & meteorological data • Policies for sharing • data among parties • Data authorization • International • cooperation • Collecting • individual opinions • Access Grid (AG) • AG environments • throughout six parties • Securing AG technique • for KOREN Production of data for severe weather prediction based on AG 2nd Year KOREN/APII-Testbed Based Virtual Collaboration Environments

15. PKNU (KR) UCLA (US) Nagoya Univ. (JP) NIED (JP) SKKU (KR) SWU (KR) International Conference 2nd Reports Results from 2003 Weekly Seminar Invited Talks Results from 2004 Weekly Seminar Invited Talks International Conference Final Reports Approaches (2004-2005) KMA (KR) From 1st Year MPICH-G2 -Applications in Grid environments AG based environments, earthquake and severe weather prediction data KOREN, APII-Testbed based international environments, earthquake and severe weather prediction data Data Grid (DG) -Integrated management -Management of distributed data Current year +1 Current year +2 Combining AG + MPICH-G2 + DG Constructing IT Infrastructure KOREN, APII-Testbed based data production for international environments, earthquakes and severe weather prediction, distributed data access techniques and its applications

16. Research Goal (2003) • Access Grid connecting KMA, SKKU, SWU and PKNU by KOREN • Seismological observation network between Korea and Japan by APII-testbed • Extended TCP/UDP protocols for high-speed communications • Data production line for disaster preventions based on MPICH-G2/GQ • Problem detections and solutions on operations for collaborative working environment based on KOREN/APII-testbed • Proceeding to the next year • Tuning among participating organizations

17. Example: Organization for Access Grid

18. Example: Applications in Access Grid • Establishment of collaborative working environments among parties including universities, laboratories and offices

19. Restrictions in R&D Project • Lack of techniques to establish efficient collaborative working environments • Sharing computational resources through high speed networks • supercomputers, cluster systems, massive storages • Policies through the tuning of management strategies • Lack of human resources in Grid environments • Need re-education programs • Invited talks and international technical forums

20. Applications and Effects • Improving National Security by establishing international networks for disaster preventions • Radical pervasive effect through a technology transfer • Create applications using KOREN and APII-testbed → Unification Effect on various areas “ET over IT” Construction of co-work environments based on KOREN and APII-testbed “α over IT”

21. Conclusion • Production and practical use of data for disaster preventions in temporally and spatially distributed computing environments • combining KOREN with Grid computing technology • Raising human resources for Grid technology • Producing detailed user guide books/manuals and sharing knowledge through them • The synergy effect caused by clustering supercomputers through KOREN • Efficient use of world best IT infrastructure