1 / 23

Virtual Lab project

Virtual Lab project. International oceanographic data and information exchange programme of IOC (IODE) Joint WMO/IOC technical commision for oceanography and marine meteorology (JCOMM) Marine Hydrophysical Institute (MHI) Vlaams Instituut voor de Zee (VLIZ). What is VLIZ ?.

deana
Download Presentation

Virtual Lab project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Virtual Lab project International oceanographic data and information exchange programme of IOC (IODE) Joint WMO/IOC technical commision for oceanography and marine meteorology (JCOMM) Marine Hydrophysical Institute (MHI) Vlaams Instituut voor de Zee (VLIZ) IODE/JCOMM/VLIZ/MHI – Virtual lab project

  2. What is VLIZ ? • VLIZ : Flanders Marine Institute • Oostende, Belgium • Supports Marine Research in Flanders • Support IODE, IOC, UNESCO • Flanders Marine Datacenter IODE/JCOMM/VLIZ/MHI – Virtual lab project

  3. Located : Oostende IODE/JCOMM/VLIZ/MHI – Virtual lab project

  4. What is the virtual lab ? • The Virtual Lab will be a computing environment collecting the data, models and interfaces needed to run hydrodynamic models for training and research. IODE/JCOMM/VLIZ/MHI – Virtual lab project

  5. Hydrodynamic models • Hydrodynamic models like POM predict water currents, wave heights and ocean circulations, so basically the movement of watermasses, and all that is carried by it. • The water movements are caused by wind, temperature and atmospheric pressure. These meteo parameters are called the forcing data because they make the waterccolumn move. These movements are then deviated by land masses and shallow waters. • The models are used in forecasting, operational mode when using predicted meteorological parameters. Important for safety at sea, stormsurge warning etc. • They can also be used in hindcasting using corrected meteo parameters. Mainly for research or training. IODE/JCOMM/VLIZ/MHI – Virtual lab project

  6. Running models • Modelling software eg. POM • Forcing data eg.NCEP • Bathymetry eg.ETOPO • Powerfull computers • Visualization software eg GRADS • Expertise & training IODE/JCOMM/VLIZ/MHI – Virtual lab project

  7. Known problems • Difficult software • Runs on Linux, command line mode • Edit fortran code, and recompile to run the model. • Install viewers, learn to operate them • Preparing data, lots of work • Download forcing data (>100Mb : bandwidth ?) • Extract bathymetry • Very computer intensive • Reformatting data • Running the model • Possible solution : Virtual Lab IODE/JCOMM/VLIZ/MHI – Virtual lab project

  8. The virtual lab • Experts will install the models • Install powerful hardware • Make use of GRID computing • Make software user friendly • Develop easier interfaces • Batch jobs download & reformat the data automatically • Make VL available through internet IODE/JCOMM/VLIZ/MHI – Virtual lab project

  9. System diagram Data providers Clients Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  10. System diagram:providers Data providers are the met-offices, oceanographic datacentres, basically any organisation that has relevant data Data providers Clients Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  11. System diagram:clients Data providers Clients User authentication based on name/password and/or certificates Can be Windows, Mac or Unix machines Software needed : at least an internet browser (IE, firefox,mozilla…) Optionally SSH , FTP , VNC, Xwindows software Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  12. System diagram:GRID Data providers Clients Data collectors Interfaces GRID network is the EGEE computing GRID, specially the BEGRID component of it. IODE computers from trainingroom Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  13. System diagram:collectors Data providers Clients Scripts written in perl, php, python, csh Run several times a day, unattended Download data from providers Extract and reformat data to the formats needed by the different models. Where appropriate the jobs can be submitted to run on the GRID network. Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  14. System diagram:repositories Computers running NFS, FTP, SMB(samba/windows) Database servers running MySQL GIS databases SAN coupled (fibre disks with Terabytes storage capacity) Data providers Clients Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  15. System diagram:interfaces Linux systems Access protocols : SSH, (s)FTP, HTTP,VNC,Xwindows SSH and FTP access will allow full control of the models WebPages can simplify the process of running the models, and allow to submit jobs on the GRID, and be used to visualise the results. VNC and Xwindows access provided the network bandwidth is available Data providers Clients Data collectors Interfaces Data repositories GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  16. Internet System diagram:flow Data providers Clients SSH, VNC, Xwindows, FTP FTP,HTTP HTTP, HTTPS Data collectors Interfaces NFS, SMB NFS, SMB, SQL Data repositories edg-job-submit edg-job-submit NFS GRID network IODE/JCOMM/VLIZ/MHI – Virtual lab project

  17. Candidate models • Selected for the JCOMM – IODE jamboree • Extra tropical storm surge (Ø.Sætra, NMI) • WAM wave model from (NMI) • Tropical storm surge (S. Dube, IIT) • Circulation model for the Black Sea (Korotaev,MHI) IODE/JCOMM/VLIZ/MHI – Virtual lab project

  18. First steps : Black sea circulation Model • Project VLIZ – MHI Ukraine • Based on POM • Running high resolution model for Blacksea is very computer intensive. • 5km resolution, 1 month : hours • 1km resolution, 1 month : days • Current approach : nested model • Low resolution model for whole BlackSea • Use this as input for high resolution model for smaller regions • Ideal for GRID computing • 1 job for whole black sea • each region = 1 job, independant of others IODE/JCOMM/VLIZ/MHI – Virtual lab project

  19. Forecasting System of the Black Sea Circulation Regional Models Family Regional Atmospheric Model (ALADIN Family) Basin-Scale Circulation Model Sea Surface Elevation Burgas Bay Georgian Zone Current Velocity NWS Regional Model Russian Coastal Zone Regional Model Romanian Coastal Zone Regional Model Sea Water Temperature and Salinity Kalamita Bay Regional Model Nowcasting system IODE/JCOMM/VLIZ/MHI – Virtual lab project

  20. low resolution Blacksea model • Lineair scalable till about 10 – 16 CPU • Will run on 2x4core CPU system with 8Gb in VL IODE/JCOMM/VLIZ/MHI – Virtual lab project

  21. regional models • Kalamita Bay • GRID cluster with 5x2x4 CPU will be used for running the regional models in parrallel IODE/JCOMM/VLIZ/MHI – Virtual lab project

  22. Planning • mid 2007 • install equipment : Blades with 5x2xQuadCores, 8Gb • install gLite middleware • install existing models • end 2007 • make models ‘GRID’ enabled • investigate MPI – POM • beginning 2008 • run model in ‘semi-operational’ forecasting mode • in parallel • start same exercise for other models IODE/JCOMM/VLIZ/MHI – Virtual lab project

  23. Thank you IODE/JCOMM/VLIZ/MHI – Virtual lab project

More Related