200 likes | 364 Views
Introduction to Grid and Grid applications. Peter Kacsuk MTA SZTAKI www.lpds.sztaki.hu. Grid. They are geographically distributed and connected by a wide-area network. Internet. What is Grid?.
E N D
Introduction to Grid and Grid applications Peter Kacsuk MTA SZTAKI www.lpds.sztaki.hu
Grid • They are geographically distributedandconnected by a wide-area network Internet What is Grid? • A Grid is a collection of computers, storages, special devices, services that can dynamically join and leave the Grid • They can be accessed on-demand by a set of users • They are heterogeneous in every aspect
Why use a Grid? • A user has a complex problem that requires many services/resources in order to • reduce computation time • access large databases • access special equipments • collaborate with other users Internet
Typical Grid application areas • High-performance computing (HPC) • to achieve higher performance than individual supercomputers/clusters can provide • Reguirement:parallel computing • High-throughput computing (HTC) • To exploit the spare cyclesof various computers connected by wide area networks • Collaborative work • Several users can jointly and remotely solve complex problems
Desktop Grid Application development • Low level API DG API • High level env. P-GRADE Tipicalapplications Param. studyM/W Param. Study, data-oriented Workflow Two basic Grid directions Grid Technology Utility Grid (EGEE, HunGrid)
Donating free resources Requiring resources Generic Grid modell Inst1 Inst4 Internet Inst2 Inst3
Dynamic resource donation Work package distribution Desktop Grid model Company/univ. server Donor: Company/Univ.orprivatePC Application Internet Donor: Company/univ.orprivatePC Donor: Company/univ. orprivatePC
SETI: a global desktop grid • SETI@home • 3.8M users in 226 countries • 1200 CPU years/day • 38 TF sustained (Japanese Earth Simulator is 32 TF sustained) • Highly heterogeneous: >77 different processor types
SZTAKI Desktop Gridperformance NIIF Supercomputer: 300 GFlops NIIF ClusterGrid: 500 GFlops OMSZ Supercomputer: 900 GFlops TOP 500 entry performance: 1645 GFlops
Dynamic resourcerequirements Utility Grid model Donating free resourcesstatic 7/24 mode Inst1 Inst2 Donor anduser Donor anduser Internet User 1 User N
The largest production Grid: EGEE Country participating in EGEE Scale > 180 sites in 39 countries > 30 000 CPUs > 5 PB storage > 10 000 concurrent jobs per day > 60 Virtual Organisations
EGEE Applications • >20 applications from 7 domains • High Energy Physics • Biomedicine • Earth Sciences • Computational Chemistry • Astronomy • Geo-Physics • Financial Simulation • Further applications in evaluation Applications now moving from testing to routine and daily usage
EGEE-II • Natural continuation of EGEE • Emphasis on providing an infrastructure for e-Science increased support for applications increased multidisciplinary Grid infrastructure more involvement from Industry • Expanded consortium • > 90 partners in 32 countries (Non-European partners in USA, Korea and Taiwan) • Related projects • world-wide Grid infrastructure • increased international collaboration
VOs and Grids used during the Summer School • VOCE: Virtual Organization Central Europe • SEE-GRID: South-East European Grid • GILDA: Training infrastructure for EGEE Grids
VOCE infrastructure • VOCE - Summary of resources • resources from CESNET (Czech Republic) PSNC, CYFRONET, ICM (Poland) II-SAS (Slovakia) KFKI (Hungary) • more than 40 registered users from 10 institutes and 4 countries • in total 539 CPUs, about 5.9 TB disk space
The GILDA Test-bed(https://gilda.ct.infn.it/testbed.html) 15 sites in 3 continents !
The GILDA Monitoring System(http://alifarm7.ct.infn.it:50080/gridice)
User concerns of Grid systems • How to cope with the variety of these Grid systems? • How to develop/create new Grid applications? • How to execute Grid applications? • How to observe the application execution in the Grid? • How to tackle performance issues? • How to port legacy applications • to Grid systems • between Grid systems? • How to execute Grid applications over several Grids in a transparent way?
Goal of the EGEE Summer School • This is a user-oriented and not a grid constructor school with goals: • To give answers for the questions above • Concentrating of the EGEE Grid technology but showing other generic solutions, too • Within EGEE concentrating on the new g-Lite middleware • Teaching the low-level EGEE user interface and APIs • Showing high-level Grid portal interfaces • Showing how to gridify applications for the EGEE Grid and for other Grids