140 likes | 302 Views
Hands-On-Globus Overview. Agenda I. What is a grid? II. Globus structure III. Use cases & Hands on! IV. AstroGrid @ AIP: Status and Plans. Introduction I: What is a Grid?. Old and new networks. Next step: Resource sharing: information processing power out of the socket.
E N D
Hands-On-Globus Overview Agenda I. What is a grid? II. Globus structure III. Use cases & Hands on! IV. AstroGrid @ AIP: Status and Plans
Next step: Resource sharing: information processing power out of the socket $ submit_job submitting job… requisitioning 7.3 Exaflops… job successful. $ publish_paper compiling & publishing… review process… 2006.nature.447.pp1103-17 OK.
What Resources can be shared? Efficient use of: • CPU-Power • storage space • special hardware (sensors, telescopes, robots) • installed applications and licenses Advantages: • load balancing, scaling • redundancy increased reliability • uniform protocol interface for arbitrary resources
Again: What is a Grid? a.k.a.“meta computing“, „distributed [parallel] computing“ • A buzz word? • A grid distributes, manages and coordiates resource sharing and collaboration without centralised control. • A grid uses standardised, open, general-purpose protocols and interfaces. • It can be (very) inhomogenious • It includes security mechanisms, even though being spread out over multiple diverse „domains“. • It is used for professional work • It is more than the sum of ist parts and non-trivial. A grid is computers plus the internet plus some more things
A grid or not a grid? • Operating Systems + the internet?? - client-server architecture, no automated network-wide components • Botnets (for spamming or DOS-Attacks)? - centrally organised • Peer-to-peer networks? - function limited to data sharing • Cluster? -too homogenius, specialised and centralised. Localised, different operating and security systems (but a good thing anyway) • SETI project or BOINC (500.000 CPUs!)? - limited function, no cooperation. A low-end grid?
Where are we on the Hype Curve? Peak of inflated expectations Gardner Group (US IT consulting company)August 2005 Trough of disillusionment
Middleware – can you see it? or: that‘s all very nice, but the devil is in the details • Grid middleware is a set of programs: demons, shell scripts, servers, java servlets, etc. • Middleware software is focused to perform specific tasks within the grid • The middleware extends the operating system to allow: • dedicated servers to perform automated management tasks • a machine to become part of the grid and share resources • a user to access and use the grid.
Introduction II: Globus Components
Globus history • 1998: Globus V1.0; currently V4.03. Work in progress… • Communities: Globus Alliance, Open Grid Forum • de-facto standard in science, core elements are stable • written mostly in C, web service layers Java and Python • uses XML for web service documents • open source „Globus is the plumbing standard of the grid, a set of blocks and tools“. Remember that grid resources are not very homogenious.
Main Globus Elements Resource Hardware: computers, storage, sensors provide: operating system, network access allow: program execution, local user management Globus Toolkit Middleware User Globus Status Information Service Execution Management Security Infrastructure Data Management Job Management Job Monitoring
The Globus Toolkit: Component Overview • About a dozen core commands for command line • Many services are available in different versions: as command line service and additionally as web (augmented) service. • Some are just „grid-improved“ versions of unix a commands • They often use „batch“ scripts (RLS, XML), models exist • Lots of acronyms… see handout!
[Cern grid flash] Does all that work together (at least in theory)?