1 / 44

Grid resources for NWP models at national level in Korea

APAN. Grid resources for NWP models at national level in Korea. 2004. 1. 29 Super Computer Center Korea Meteorological Administration. K orean M eteorological Administration. APAN. Contents. What the operational weather forecasting is Why the operational centers need Grid Technology.

apollo
Download Presentation

Grid resources for NWP models at national level in Korea

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. APAN Grid resources for NWP models at national level in Korea 2004. 1. 29 Super Computer Center Korea Meteorological Administration Korean Meteorological Administration

  2. APAN Contents • What the operational weather forecasting is • Why the operational centers need Grid Technology. • What Grid activities are in the Meteorological field. • What we have and will do with IT infrastructure. Korean Meteorological Administration

  3. APAN What the operational weather forecasting is… Korean Meteorological Administration

  4. Technology for the weather forecasting collection Anal.& WF Diss. observation Numerical Weather Prediction

  5. APAN Infrastructure for Earth System Korean Meteorological Administration

  6. Nature

  7. APAN World Meteorological Organization (187members) DATA CONVEYORS Global Telecommunication System GTS DATA PRODUCERS Global Observing System GOS DATA USERS Global Data Processing System GDPS Korean Meteorological Administration

  8. APAN Current GTS will be replaced with FWIS until 2010 Korean Meteorological Administration

  9. APAN 연구배경 Some Characteristics of Earth Science • Global Scale Study => climatology with Atmos., Ocean, land surface, etc • Global Observation and sharing information • Co-work with international society is important global science with huge observation data and high performance computing • Dynamic Equation Set • Numerical Representation • Super Computing Korean Meteorological Administration

  10. APAN Why we need Grid Korean Meteorological Administration

  11. APAN Archived data volume and the Moore law Source: CAS2k3 , MetroFrance Korean Meteorological Administration

  12. APAN Daily transfer volume Source:CAS2K3 DKRZ Korean Meteorological Administration

  13. APAN Source:CAS2K3 DKRZ Korean Meteorological Administration

  14. APAN Data Size in Operational Center ( DWD ) Korean Meteorological Administration

  15. APAN Forget Modeling: How About Case Study Research? • Exhaustive study of one or more selected observed weather events, sometimes involving the use of models and always involving lots of data! • We spend 70% of our time dealing with data logistics, i.e., searching, formatting, acquiring, reading, reducing, merging onto common grids and projections, visualizing, etc… - Radar, satellite, surface nets, GPS, upper-air balloon, commercial aircraft, wind profiler, etc… • And only ~30% of our time is spent actually studying the event! Source: LEAD, Prof. Kelvin Korean Meteorological Administration

  16. WGNE Table of Operational NWP Centres (November 2002; ref. Kamal Puri) APAN Source : CAS2k3 M.Naughton BOM Korean Meteorological Administration

  17. APAN What Grid activities are in the Meteorological field Korean Meteorological Administration

  18. APAN The Grid and Meteorology:Opportunities • Inter-personal collaboration - E.g., Access Grid, CHEF • On-demand access to simulation models - E.g., Espresso • Access to, and integration of, data sources - E.g., Earth System Grid • Dynamic, virtual computing resources - “Metacomputing” • Integration of all of the above - Collaborative, computationally intensive analysis of large quantities of online data Source : Ian Foster, 16th APAN Meeting Korean Meteorological Administration

  19. Computational grid example APAN European Grid www.eurogrid.org Korean Meteorological Administration

  20. Computational grid example(cont.) APAN Korean Meteorological Administration

  21. APAN Korean Meteorological Administration

  22. Data grid example APAN Earth System Grid Korean Meteorological Administration

  23. APAN http://lead.ou.edu Korean Meteorological Administration

  24. APAN LEAD Concept Korean Meteorological Administration

  25. APAN LEAD Data Cloud Korean Meteorological Administration

  26. APAN What we have Korean Meteorological Administration

  27. APAN High Speed Network - KOREN Korean Meteorological Administration

  28. APAN High Speed Network - KREONET Korean Meteorological Administration

  29. APAN High Speed Network – International Link Korean Meteorological Administration

  30. APAN KMA Intra Network Korean Meteorological Administration

  31. KMA HPC and Network Giga.E Gigabit Switch1 Filer1 Fast.E SX-5/16A Front- End System XYLAN Filer2 F/W Gigabit Switch2 Backup System SX-5/12A KOREN KMA Backbone G-NEt MRI KREONET APAN Korean Meteorological Administration

  32. APAN What we will do Korean Meteorological Administration

  33. APAN • NEXT KMA HPC System • 54 times faster than the current system • Initial stage : 6 times 4Q 2004 • Final stage : 54 times 4Q 2005 • More than 80M$ for next 5 years • Plan for the National Data Center : from 2004 • To collect Obs. Data • To disseminate Weather Information and Product • Digital Weather Forecast • Fine Mesh Weather Grid Information • Real time Dissemination Korean Meteorological Administration

  34. APAN • KMA Met Satellite at 2008 • Representative of Group on Earth Observation • V-GISC • Future WMO Information System • E-Science for Earth System • APEC Climate Network Korean Meteorological Administration

  35. APAN Test for the collaboration in the field of Met. with High Speed Network target Data Grid For sharing Huge data Virtual Storage for Huge Met. Data User Interface based on 3D, VR Parallel Development of modules Virtual Lab Computational grid Re-locatable and adoptive grid model Computational grid Access grid for parallel development of model codes Access Grid Korean Meteorological Administration

  36. user Module 4 Module 1 모듈4 모듈1 Module 3 모듈3 module2 모듈2 연구 방법 APAN Computational grid for Meteo. Application(Distributed Computing) • Using High Speed Network ( KOREN, KREONET ) • Real Time Allocation of computing resource and data resource, sharing model codes • re-locatable grid with friendly UI for high resolution model Group A Module 1 Group B Module 2 Computing Res. Data Res. Model Data Res. Computing Res. Group C Module 3 Group D Module 4 Korean Meteorological Administration

  37. User 연구 방법 APAN System development for the sharing huge Met. data • Development of User Interface • virtual storage based on Grid Technology • technique development for Remote Display based on 3D,VR Grid FTP Storage C Virtual Storage Display Data Catalog Manager Request Manager Grid FTP Storage B Replica Catalog Manager Grid FTP Storage A Korean Meteorological Administration

  38. 연구 배경 APAN Current research status – individual off-line Group A Module1 Module2 Module3 … Group B Module1 Module2 Module3 … One-Side Media Off-Line Media conference meeting E-Mail Phone/Fax Group C Module1 Module2 Module3 … Group D Module1 Module2 Module3 … Korean Meteorological Administration

  39. 연구 방법 APAN Access Grid for Collaboration • Access grid for parallel- development • Parallel computing based on high performance computing Local A Data Grid Display system 3D, VR Local B Discussion Forum Access Grid Video Conference Exchange E-Message Local C Computing Grid Co-operational Project Korean Meteorological Administration

  40. APAN For the High quality weather information - More regional and global Observation Data - Data assimilation - High Performance Computing - Ensemble Prediction for regional and global scale - Enhance the research activity - Training and Education Korean Meteorological Administration

  41. APAN Thank you!! Korean Meteorological Administration

  42. Data Exchange with National Information Center for Earthquakes and Disasters, National Research Institute for Earth Science and Disaster Prevention

  43. APAN Earthquake and Zunami Korean Meteorological Administration

More Related