440 likes | 452 Views
Learn about the importance of grid technology in operational weather forecasting centers and its role in enhancing meteorological field activities in Korea. Explore the IT infrastructure and future plans of the Korean Meteorological Administration.
E N D
APAN Grid resources for NWP models at national level in Korea 2004. 1. 29 Super Computer Center Korea Meteorological Administration Korean Meteorological Administration
APAN Contents • What the operational weather forecasting is • Why the operational centers need Grid Technology. • What Grid activities are in the Meteorological field. • What we have and will do with IT infrastructure. Korean Meteorological Administration
APAN What the operational weather forecasting is… Korean Meteorological Administration
Technology for the weather forecasting collection Anal.& WF Diss. observation Numerical Weather Prediction
APAN Infrastructure for Earth System Korean Meteorological Administration
APAN World Meteorological Organization (187members) DATA CONVEYORS Global Telecommunication System GTS DATA PRODUCERS Global Observing System GOS DATA USERS Global Data Processing System GDPS Korean Meteorological Administration
APAN Current GTS will be replaced with FWIS until 2010 Korean Meteorological Administration
APAN 연구배경 Some Characteristics of Earth Science • Global Scale Study => climatology with Atmos., Ocean, land surface, etc • Global Observation and sharing information • Co-work with international society is important global science with huge observation data and high performance computing • Dynamic Equation Set • Numerical Representation • Super Computing Korean Meteorological Administration
APAN Why we need Grid Korean Meteorological Administration
APAN Archived data volume and the Moore law Source: CAS2k3 , MetroFrance Korean Meteorological Administration
APAN Daily transfer volume Source:CAS2K3 DKRZ Korean Meteorological Administration
APAN Source:CAS2K3 DKRZ Korean Meteorological Administration
APAN Data Size in Operational Center ( DWD ) Korean Meteorological Administration
APAN Forget Modeling: How About Case Study Research? • Exhaustive study of one or more selected observed weather events, sometimes involving the use of models and always involving lots of data! • We spend 70% of our time dealing with data logistics, i.e., searching, formatting, acquiring, reading, reducing, merging onto common grids and projections, visualizing, etc… - Radar, satellite, surface nets, GPS, upper-air balloon, commercial aircraft, wind profiler, etc… • And only ~30% of our time is spent actually studying the event! Source: LEAD, Prof. Kelvin Korean Meteorological Administration
WGNE Table of Operational NWP Centres (November 2002; ref. Kamal Puri) APAN Source : CAS2k3 M.Naughton BOM Korean Meteorological Administration
APAN What Grid activities are in the Meteorological field Korean Meteorological Administration
APAN The Grid and Meteorology:Opportunities • Inter-personal collaboration - E.g., Access Grid, CHEF • On-demand access to simulation models - E.g., Espresso • Access to, and integration of, data sources - E.g., Earth System Grid • Dynamic, virtual computing resources - “Metacomputing” • Integration of all of the above - Collaborative, computationally intensive analysis of large quantities of online data Source : Ian Foster, 16th APAN Meeting Korean Meteorological Administration
Computational grid example APAN European Grid www.eurogrid.org Korean Meteorological Administration
Computational grid example(cont.) APAN Korean Meteorological Administration
APAN Korean Meteorological Administration
Data grid example APAN Earth System Grid Korean Meteorological Administration
APAN http://lead.ou.edu Korean Meteorological Administration
APAN LEAD Concept Korean Meteorological Administration
APAN LEAD Data Cloud Korean Meteorological Administration
APAN What we have Korean Meteorological Administration
APAN High Speed Network - KOREN Korean Meteorological Administration
APAN High Speed Network - KREONET Korean Meteorological Administration
APAN High Speed Network – International Link Korean Meteorological Administration
APAN KMA Intra Network Korean Meteorological Administration
KMA HPC and Network Giga.E Gigabit Switch1 Filer1 Fast.E SX-5/16A Front- End System XYLAN Filer2 F/W Gigabit Switch2 Backup System SX-5/12A KOREN KMA Backbone G-NEt MRI KREONET APAN Korean Meteorological Administration
APAN What we will do Korean Meteorological Administration
APAN • NEXT KMA HPC System • 54 times faster than the current system • Initial stage : 6 times 4Q 2004 • Final stage : 54 times 4Q 2005 • More than 80M$ for next 5 years • Plan for the National Data Center : from 2004 • To collect Obs. Data • To disseminate Weather Information and Product • Digital Weather Forecast • Fine Mesh Weather Grid Information • Real time Dissemination Korean Meteorological Administration
APAN • KMA Met Satellite at 2008 • Representative of Group on Earth Observation • V-GISC • Future WMO Information System • E-Science for Earth System • APEC Climate Network Korean Meteorological Administration
APAN Test for the collaboration in the field of Met. with High Speed Network target Data Grid For sharing Huge data Virtual Storage for Huge Met. Data User Interface based on 3D, VR Parallel Development of modules Virtual Lab Computational grid Re-locatable and adoptive grid model Computational grid Access grid for parallel development of model codes Access Grid Korean Meteorological Administration
user Module 4 Module 1 모듈4 모듈1 Module 3 모듈3 module2 모듈2 연구 방법 APAN Computational grid for Meteo. Application(Distributed Computing) • Using High Speed Network ( KOREN, KREONET ) • Real Time Allocation of computing resource and data resource, sharing model codes • re-locatable grid with friendly UI for high resolution model Group A Module 1 Group B Module 2 Computing Res. Data Res. Model Data Res. Computing Res. Group C Module 3 Group D Module 4 Korean Meteorological Administration
User 연구 방법 APAN System development for the sharing huge Met. data • Development of User Interface • virtual storage based on Grid Technology • technique development for Remote Display based on 3D,VR Grid FTP Storage C Virtual Storage Display Data Catalog Manager Request Manager Grid FTP Storage B Replica Catalog Manager Grid FTP Storage A Korean Meteorological Administration
연구 배경 APAN Current research status – individual off-line Group A Module1 Module2 Module3 … Group B Module1 Module2 Module3 … One-Side Media Off-Line Media conference meeting E-Mail Phone/Fax Group C Module1 Module2 Module3 … Group D Module1 Module2 Module3 … Korean Meteorological Administration
연구 방법 APAN Access Grid for Collaboration • Access grid for parallel- development • Parallel computing based on high performance computing Local A Data Grid Display system 3D, VR Local B Discussion Forum Access Grid Video Conference Exchange E-Message Local C Computing Grid Co-operational Project Korean Meteorological Administration
APAN For the High quality weather information - More regional and global Observation Data - Data assimilation - High Performance Computing - Ensemble Prediction for regional and global scale - Enhance the research activity - Training and Education Korean Meteorological Administration
APAN Thank you!! Korean Meteorological Administration
Data Exchange with National Information Center for Earthquakes and Disasters, National Research Institute for Earth Science and Disaster Prevention
APAN Earthquake and Zunami Korean Meteorological Administration