250 likes | 334 Views
SC2003 Video. Teragrid. An Introduction to Grids. Peter Clarke / clarke@hep.ucl.ac.uk IoP Meeting / Portland Place / 11-Feb-04. Scientific Requirements for Grids What is a Grid ? A word on Interoperation & Standardisation Where can you find a Grid Concluding thoughts.
E N D
Teragrid An Introduction to Grids Peter Clarke / clarke@hep.ucl.ac.uk IoP Meeting / Portland Place / 11-Feb-04
Scientific Requirements for Grids • What is a Grid ? • A word on Interoperation & Standardisation • Where can you find a Grid • Concluding thoughts
Take a tunnel ……. Fill with magnets and expensive Detectors.. Smash protons together and catch the debris … Discover the origin of mass Particle Physics
~PByte/sec ~100-400 MBytes/sec Online System Experiment CERN 700k SI95 ~1 PB Disk; Tape Robot Tier 0 +1 HPSS ~1-10 Gbps Tier 1 FNAL: 200k SI95; 600 TB IN2P3 Center INFN Center RAL Center Tier2 Center Tier2 Center Tier2 Center Tier2 Center Tier2 Center ~1-10 Gbps Tier 3 HPSS HPSS HPSS HPSS Institute ~0.25TIPS Institute Institute Institute Physics data cache 0.1–1 Gbps Tier 4 Workstations ~1-10 Gbps
Crab Nebula Chandra X-ray HST optical X-ray Optical Gemini mid-IR VLA radio Jet in M87 Infra-red Radio Astronomy • Federation of astronomical surveys • On demand discovery of information relevant to a study
Other information Digitise Remote Radiographers More opinions Mammography Current system very Minimal technologically
These applications generate Grid like distributed computing requirements: • Massive & Dynamic resources for compute and store • – leading to registration and discovery requirements • Federation of heterogeneous systems • Federation of many disparate data and meta data • Access for many widespread “loosely connected” • users with a “standard” credential • Replication management • Secure virtual systems (“VPGs”) • On demand access to vast compute power • Inter resource accounting • Agreements……………..
So … What is a GRID … many things to many people…. • Federation of Clusters • Virtualisation of computing • Heterogeneity • Discovery • Standards • …
At the highest level it is computing coming out of a wall socket…. Computing: ? ? Power: 110V AC 60Hz
User/Application Information/ Databases User registration Storage Resource Compute resource
Middleware: Web Client Middleware: Web Server Middleware: Web Server Look at analogue in WWW User/Application Standards for access (HTTP on port 80) Information/ Databases
Client Discovery & Access Credential Management Subscription & Publication ~~~~~ ~~~~ ~~~~~ Credential issue Resource Brokering Third party services Access & Publication Access & Publication User/Application Resource availability Directories User registration
E = mc2 @#%&*! Grid Middleware … or as stolen form S.Lloyd… “Putting the bottleneck back in the Scientist’s mind”
GRID middleware Authentication Resource Information Resource Allocation Data access Metadata cataloguing Resource specific services Authorisation Network protocols& services CPU schedulers Mass storage access Leads to need for GRID middleware to mediate all this : Application
Virtualisation Network Today: Virtual Private Network (VPN): Virtualises Network connection between sites Makes enterprise think it owns a dedicated secure connection
The Grid Tomorrow: Virtual Private Grid (VPG): Virtualises Computing, Storage and Network connection between sites Makes enterprise think it owns a dedicated secure computer system
Service The Grid Service Service Service Service Service Next Year: Virtual Private Services ???: Everything built from robust, interacting secure services provided by trusted GridCos
A word on interoperability and Standards • Grids will not work by adapting each grid to talk to another. Or adopting the same bespoke software. • Grids will work by defining and agreeing standards in analogy with the internet • This is the Goal of the Global Grid Forum – it’s a long and hard job
Some Grid Testbeds The UK e-Science Grid UK Particle Physics Testbed (GridPP) The European DataGrid Testbed
Some Grid Production Services UK Particle Physics Testbed (GridPP-2) UK E-Science Grid – 2 The JISC Clusters
EGEE A production Europe Grid for An EU Flagship Project Starting Now EGEE will bind national infrastructures - focussing all activities towards establishing a production quality Grid for Europe
Concluding Remarks Grids are an evolution which was waiting to happen Grids are about seamless discovery and use of heterogeneous resources around the globe Grids are about standards for interoperation, just as the internet only works because of standards Grids are about “virtualising” Computing just as a “VPN” virtualised a leased line Grids are set to evolve to a Web-Services framework – where everything is just a set of self describing, discoverable, interoperating services