200 likes | 351 Views
Grid based Flood Prediction Virtual Organization. 2 nd International IEEE Conference on e-Science and Grid Computing. Dr. Ladislav Hluchy, II SAS, Slovakia. Data warehouse. Data warehouse. Proccess node. Proccess node. Proccess node. MEDIGRID.
E N D
Grid based Flood Prediction Virtual Organization 2nd International IEEE Conference on e-Science and Grid Computing Dr. Ladislav Hluchy, II SAS, Slovakia
Data warehouse Data warehouse Proccess node Proccess node Proccess node MEDIGRID Mediterranean Grid of Multi-risk data and Models Testbed • Meteorological data • Soil properties Erosion Registered user • Hydrological data • Fire Maps • Fire station Web portal • Flood DATA Locate (find) input data Access data Get data Transfer data to the PN PROCESSES Locate process Execute process • TempSim • RHSim • NUATMOS • Fire propagation-1 Visualization of maps and tables Dec. 4- 6, 2006, Amsterdam
MeteoDataRes FloodDataRes GenericDataRes TerainDataRes soil_1 soil_2 meteo_1 meteo_2 soil_type_4 terrain_5 soil_moist_4 OFmap_5 Replica location Metadata catalog Central services Informationindex Hydraulics Meteo Hydrology Hydrology Dec. 4- 6, 2006, Amsterdam
FloodDataRes Request file meteo_1 (subject to authentication& authorization) Transfer of meteo_1 soil_type_4 terrain_5 meteo_1 meteo_out_1 MeteoDataRes FloodDataRes GenericDataRes TerainDataRes FloodDataRes meteo_1 meteo_2 soil_type_4 terrain_5 soil_moist_4 OFmap_5 soil_1 soil_2 soil_type_4 terrain_5 meteo_1 Locate meteo_1 Register new replica of file meteo_1 meteo_1 located at Site1 Register file meteo_out_1 Submit Job, specify LFNs of data sets (e.g. meteo_1) Job finished Search metadata LFNs of required data found Hydraulics Executionof job starts Meteo Executionfinished Hydrology Hydrology Site1 Site2 Replica location Metadata catalog Central services Job finished Informationindex Dec. 4- 6, 2006, Amsterdam
FloodGrid Portal Dec. 4- 6, 2006, Amsterdam
FloodGrid Portal Dec. 4- 6, 2006, Amsterdam
K-Wf Grid - Objectives • To enable users to create complex workflows and use grid resources without detailed knowledge of grid • To construct workflows optimized for underlying infrastructure, using its advantages and avoiding its bottlenecks • To (semi-)automatically construct workflows based on user’s requirements, using semantic annotation of services, data, applications and resources • To constantly renew information about the grid by using complex monitoring network – to learn from experience • To provide simple, easy-to-use interface to K-Wf Grid services Dec. 4- 6, 2006, Amsterdam
K-Wf Grid: Concept Execute workflow Monitor environment Construct workflow Analyze information Reuse knowledge Capture knowledge Dec. 4- 6, 2006, Amsterdam
K-Wf Grid - Architecture User User interaction through the Portal Guidances for the user Knowledge Web Portal Grid Workflow User Interface User Assistant Agent Grid Organizational Memory Information on available resources and their description Workflow composition and execution visualization User’s decisions in crucial points of execution Ontological store of knowledge Workflow Orchestration and Execution Automatic Application Builder Workflow Composition Tool Analysed and extracted knowledge Information about workflow execution Scheduler PerformanceAnalysis KnowledgeAssimilation Agent Grid Workflow Execution Service Information about performance of particular resources Information about resources and environment Execution of chosen Grid services Low Level Grid Middleware (WS-RF) Grid Performance Monitoringand Instrumentation Service Grid Resources Dec. 4- 6, 2006, Amsterdam
Replica location Metadata catalog Central services Informationindex Dec. 4- 6, 2006, Amsterdam
Monitoring service Replica location Metadata catalog Central services Informationindex Dec. 4- 6, 2006, Amsterdam
Monitoring service Knowledge store Information processing Workflow management Replica location Metadata catalog Central services Informationindex Dec. 4- 6, 2006, Amsterdam
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Informationindex Dec. 4- 6, 2006, Amsterdam
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge
Monitoring service Knowledge store Information processing Workflow management Replica location Portal Metadata catalog Central services Execute workflow Informationindex Monitor environment Construct workflow Analyze information Dec. 4- 6, 2006, Amsterdam Reuse knowledge Capture knowledge