Service Oriented Architecture & Grid Computing

1. Service Oriented Architecture & Grid Computing Marc Brooks, The MITRE Corporation The author's affiliation with The MITRE Corporation is provided for identification purposes only, and is not intended to convey or imply MITRE's concurrence with, or support for, the positions, opinions or viewpoints expressed by the author.

2. What is Grid Computing? “A computational grid is a hardware and software infrastructure that provides dependable, consistent, pervasive, and inexpensive access to high-end computational capabilities.” -”The Grid: Blueprint for a New Computing Infrastructure”, Kesselman & Foster Criteria for a Grid*: • Coordinates resources that are not subject to centralized control. • Uses standard, open, general-purpose protocols and interfaces. • Delivers nontrivial qualities of service Source: “What is the Grid? A Three Point Checklist”, Ian Foster, Argonne National Laboratory & University of Chicago

3. Grid Computing Benefits • Exploit Underutilized resources • CPU Scavenging, Hotspot leveling • Resource Balancing • Virtualize resources across an enterprise • Data Grids, Compute Grids • Enable collaboration for virtual organizations

4. Two Key Grid Computing Groups The Globus Alliance (www.globus.org) • Composed of people from: Argonne National Labs, University of Chicago, University of Southern California Information Sciences Institute, University of Edinburgh and others. • OGSA/I standards initially proposed by the Globus Group • Based off papers “Anatomy of the Grid” & “Physiology of the Grid” The Global Grid Forum (www.ggf.org) • History • First meeting in June of 1999, Based off the IETF charter • Heavy involvement of Academic Groups and Industry • (e.g. IBM Grid Computing, HP, United Devices, Oracle, UK e-Science Programme, US DOE, US NSF, Indiana University, and many others) • Process • Meets three times annually • Solicits involvement from industry, research groups, and academics

5. Companies involved in Grid Computing • Avaki • Axceleon • CapCal • Centrata • DataSynapse • Distributed Science • Elepar • Entropia.com • Grid Frastructure • GridSystems • Groove Networks • IBM • Intel • Jivalti • Mithral • Mind Electric • Mojo Nation • NewsToYou.com • NICE, Italy • Noemix, Inc. • Oracle • Parabon • Platform Computing • Popular Power • Powerllel • ProcessTree • Sharman Networks Kazza • Sun Gridware • Sysnet Solutions • Tsunami Research • Ubero • United Devices • Veritas • Xcomp Source: http://www.gridcomputing.com/

6. Standards involved with SOA & Grid Computing SOA Standards • WSDL • UDDI • BPEL • WS-Profile • WS-Security • WS-Choreography And many others… Grid Standards • OGSI • Extension to WSDL • WS-Resource • WS-ResourceLifetime • WS-ResourceProperties • WS-RenewableReferences • WS-ServiceGroup • WS-BaseFaults

7. Started far apart in applications & technology Grid and Web Services Standards Grid GT1 GT2 OGSi WS-I Compliant Technology Stack Have been converging WSRF BPEL WS-* WSDL, SOAP XML HTTP Web Convergence of Core Technology Standards allows Common base for Business and Technology Services

8. Service Oriented Architecture “What is Service-Oriented Architecture?”. Hao He. http://webservices.xml.com/lpt/a/ws/2003/09/30/soa.html “Service-Oriented Architecture: A Primer”. Michael S. Pallos. http://www.bijonline.com/PDF/SOAPallos.pdf “The Benefits of a Service-Oriented Architecture”. Michael Stevens. http://www.developer.com/design/article.php/1041191 Web Services Specifications - http://www.w3.org/2002/ws/ Grid Computing Global Grid Forum (http://www.ggf.org) The Globus Alliance ( http://www.globus.org) “The Physiology of the Grid”. Ian Foster, Carl Kesselman, Jeffrey M. Nick, Steven Tuecke. http://www.globus.org/research/papers/ogsa.pdf “The Anatomy of the Grid”. Ian Foster, Carl Kesselman, Steven Tuecke. http://www.globus.org/research/papers/anatomy.pdf Web Services Resource Framework - http://www.globus.org/wsrf/

9. What is the Grid? • The World Wide Web provides seamless access to information that is stored in many millions of different geographical locations • In contrast, the Grid is an emerging infrastructure that provides seamless access to computing power and data storage capacity distributed over the globe. From: http://gridcafe.web.cern.ch/gridcafe/demos/Grid-beginners.ppt

10. What is the Grid? • The term Grid was coined by Ian Foster and Carl Kesselman (Grid bible “The Grid: blueprint for a new computing infrastructure”). • The name Grid is chosen by analogy with the electric power grid: plug-in to computing power without worrying where it comes from, like a toaster. • The idea has been around under other names for a while (distributed computing, metacomputing, …). • This time, technology is in place to realise the dream on a global scale.

11. How will it work? • The Grid relies on advanced software, called middleware, which ensures seamless communication between different computers and different parts of the world • The Grid search engine will not only find the data the scientist needs, but also the data processing techniques and the computing power to carry them out • It will distribute the computing task to wherever in the world there is spare capacity, and send the result to the scientist

12. How will it work? The GRID middleware: • Finds convenient places for the scientists “job” (computing task) to be run • Optimises use of the widely dispersed resources • Organises efficient access to scientific data • Deals with authentication to the different sites that the scientists will be using • Interfaces to local site authorisation and resource allocation policies • Runs the jobs • Monitors progress • Recovers from problems … and …. Tells you when the work is complete and transfers the result back!

13. What are the challenges? Must share data between thousands of scientists with multiple interests Must link major computer centres, not just PCs Must ensure all data accessible anywhere, anytime Must grow rapidly, yet remain reliable for more than a decade Must cope with different management policies of different centres Must ensure data security: more is at stake than just money! Must be up and running by 2007

14. Benefits for Science • More effective and seamless collaboration of dispersed communities, both scientific and commercial • Ability to run large-scale applications comprising thousands of computers, for wide range of applications • Transparent access to distributed resources from your desktop, or even your mobile phone • The term “e-Science” has been coined to express these benefits

15. Grid projects in the world • UK e-Science Grid • Netherlands – VLAM, PolderGrid • Germany – UNICORE, Grid proposal • France – Grid funding approved • Italy – INFN Grid • Eire – Grid proposals • Switzerland - Network/Grid proposal • Hungary – DemoGrid, Grid proposal • Norway, Sweden - NorduGrid • NASA Information Power Grid • DOE Science Grid • NSF National Virtual Observatory • NSF GriPhyN • DOE Particle Physics Data Grid • NSF TeraGrid • DOE ASCI Grid • DOE Earth Systems Grid • DARPA CoABS Grid • NEESGrid • DOH BIRN • NSF iVDGL • DataGrid (CERN, ...) • EuroGrid (Unicore) • DataTag (CERN,…) • Astrophysical Virtual Observatory • GRIP (Globus/Unicore) • GRIA (Industrial applications) • GridLab (Cactus Toolkit) • CrossGrid (Infrastructure Components) • EGSO (Solar Physics)

16. Grid Applications for Science • Medical/Healthcare(imaging, diagnosis and treatment ) • Bioinformatics(study of the human genome and proteome to understand genetic diseases) • Nanotechnology (design of new materials from the molecular scale) • Engineering(design optimization, simulation, failure analysis and remote Instrument access and control) • Natural Resources and the Environment (weather forecasting, earth observation, modeling and prediction of complex systems)

17. Medical/Healthcare Applications “The Grid will enable a standardized, distributed digital mammography resource for improving diagnostic confidence" • Digital image archives • Collaborative virtual environments • On-line clinical conferences “The Grid makes it possible to use large collections of images in new, dynamic ways, including medical diagnosis.” “The ability to visualise 3D medical images is key to the diagnosis of pathologies and pre-surgical planning” Quotes from: http://gridoutreach.org.uk

18. Bioinformatics • Capturing the complex and evolving patterns of genetic information, determining the development of an embryo • Understanding the genetic interactions that underlie the processes of life-form development, disease and evolution. “Every time a new genome is sequenced the result is compared in a variety of ways with other genomes. Each code is made of 3.5 billion pairs of chemicals…”

19. Nanotechnology • New and 'better' materials • Benefits in pharmaceuticals, agrochemicals, food production, electronics manufacture from the faster, cheaper discovery of new catalysts, metals, polymers, organic and inorganic materials “The Grid has the potential to store and analyze data on a scale that will support faster, cheaper synthesis of a whole range of new materials.” Quotes from: http://gridoutreach.org.uk

20. Natural Resources/Environment • Modeling and prediction of earthquakes • Climate change studies and weather forecast • Pollution control • Socio-economic growth planning, financial modeling and performance optimization “Federations of heterogeneous databases can be exploited through the Grid to solve complex questions about global issues such as biodiversity.” Quotes from: http://gridoutreach.org.uk

21. Precursors of the Grid • SETI@home: sharing of spare PC processing power to analyze radio signals • Napster: sharing of data (music) between computers • Entropia DCGrid: commercial solution for sharing workstations within a company The difference: The Grid CERN is developing will combine resources at major computer centers, and require dedicated equipment and sophisticated middleware to monitor and allocate resources

22. SETI@home: a grassroots Grid >1 million years of computer processing time >3.5 million have downloaded the screensaver >30 Teraflops rating (ASCI White = 12 Teraflops)

23. Spinoff from SETI@home Spawned a cottage industry Xpulsar@home, Genome@home, Folding@home, evolutionary@home, FightAIDS@home, SARS@home... Spawned a real industry Entropia, United Devices, Popular Power... Major limitations: Only suitable for “embarrasingly parallel” problems Cycle scavenging relies on goodwill

24. Who will use Grids? • Computational scientists & engineers: large scale modeling of complex structures • Experimental scientists: storing and analyzing large data sets • Collaborations: large scale multi-institutional projects • Corporations: global enterprises and industrial partnership • Environmentalists: climate monitoring and modeling • Training & education: virtual learning rooms and laboratories

25. Comments on Grid Computing • What is Applicability of Grid Computing to the Medical Domain and its Applications? • Let’s Review Three Other Presentations Briefly • http://www.aci-agir.org/publis/posterAgirParistic2006.PPT • http://bmi.osu.edu/resources/presentations/BISR_overview_poster.ppt • http://www.dma.unina.it/~murli/ISSGC06/session-31.5/ISSGC06%20Experience%20with%20biomed%20applications%20v1.ppt • All Links on Course Web Page