1 / 31

Grid and Web Services convergence and the impact on enterprise computing

Grid and Web Services convergence and the impact on enterprise computing. Takanori Seki, Distinguished Engineer Grid Computing Business, IBM Japan. 22-60. Contents. Enterprise Computing History Virtual Organization and Grid Computing Web Services Evolution with SOA

richard_edik
Download Presentation

Grid and Web Services convergence and the impact on enterprise computing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid and Web Services convergence and the impact on enterprise computing Takanori Seki, Distinguished Engineer Grid Computing Business, IBM Japan 22-60

  2. Contents • Enterprise Computing History • Virtual Organization and Grid Computing • Web Services Evolution with SOA • Grid and Web Services Convergence • Adoption and Expansion of Grid Application • Summary © 2004 IBM Corporation

  3. Enterprise Computing History (Blank Page) © 2004 IBM Corporation

  4. 1st Generation Enterprise Computing • Discrete Business Applications within Enterprise • Coupled by manual or batch processing • Separate application sets like Order, Inventory, Accounting • Through print-out or screen-scraper • Local optimization on each business operation • Data silo issue © 2004 IBM Corporation

  5. 2nd Generation Enterprise Computing • Monolithic Integration with Package Apps around Business Process • ERP package integrates a set of application tightly but monolithic • Data silo issue resolved within ERP • Needs many customization to adopt • New business application packages create higher level data silo issue • Between application packages like CRM, e-commerce, SCM etc. • B2B and B2C create new integration needs across enterprises © 2004 IBM Corporation

  6. 3rd Generation Enterprise Computing • EAI needs by On-demand Business • ERP and monolithic application packages integration through EAI (Enterprise Application Integration) • Has to be responsive through entire processes as enterprise in network economy • Still tightly non-flexible integration between business processes • No dynamic partnership enabled • Difficult to change and create new process (70% of IT budget spent for current system-associated maintenance) • Difficult to change IT resource for business transaction fluctuation • Huge spike as e-commerce nature © 2004 IBM Corporation

  7. Next-Generation Enterprise Computing • Enterprise Application Needs for Network Economy • Build business process dynamically as composite services within Enterprise and across Enterprise • Disintegrate monolithic business processes • Long business transaction to complete a business process • Dynamic resource allocation for transaction fluctuation © 2004 IBM Corporation

  8. Virtual Organization and Grid Computing (Blank Page) © 2004 IBM Corporation

  9. ~PBytes/sec ~100 MBytes/sec Offline Processor Farm ~20 TIPS There is a “bunch crossing” every 25 nsecs. There are 100 “triggers” per second Each triggered event is ~1 MByte in size ~100 MBytes/sec Online System Tier 0 CERN Computer Centre ~622 Mbits/sec or Air Freight (deprecated) Tier 1 France Regional Centre Germany Regional Centre Italy Regional Centre FermiLab ~4 TIPS ~622 Mbits/sec Tier 2 Tier2 Centre ~1 TIPS Caltech ~1 TIPS Tier2 Centre ~1 TIPS Tier2 Centre ~1 TIPS Tier2 Centre ~1 TIPS HPSS HPSS HPSS HPSS HPSS ~622 Mbits/sec Institute ~0.25TIPS Institute Institute Institute Physics data cache ~1 MBytes/sec 1 TIPS is approximately 25,000 SpecInt95 equivalents Physicists work on analysis “channels”. Each institute will have ~10 physicists working on one or more channels; data for these channels should be cached by the institute server Pentium II 300 MHz Pentium II 300 MHz Pentium II 300 MHz Pentium II 300 MHz Tier 4 Physicist workstations Example of Scientific Application • Similar Requirements in Scientific Application • Build research process dynamically as composite services across Internet • Dynamic resource allocation through Internet • Science applications leap from discrete applications to Grid through WWW http://www.griphyn.orghttp://www.ppdg.net http://www.eu-datagrid.org © 2004 IBM Corporation

  10. The Grid • Enterprise Computing Reached Grid Story • “Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations” • Enable integration of distributed resources • Using general-purpose protocols & infrastructure • To achieve better-than-best-effort service “The Grid: Beyond the Hype” by Ian Foster, 2004 © 2004 IBM Corporation

  11. Grid and Web Services for Next-Gen Needs • Common Next Generation Computing • Dynamic virtual organization formation as business/research process • Long transaction as business/research process • Reliable processing over unreliable network • Technology Requirements • Meta-Operating System to form a virtual organization over heterogeneous environment • Loosely-coupled application/resource • Monolithic application decomposition for dynamic integration • Asynchronous and reliable message driven communication pipe • System management infrastructure over Internet • The answer is “Grid and Web Services” © 2004 IBM Corporation

  12. Horizontal Process Business Flexibility IT Simplification Partners Partners Partners On-Demand Operating Environment • IBM’s Articulation of Next-Gen Enterprise IT Environment Integration • Business Modeling • Process Transformation • Application & Information Integration • Access • Collaboration • Business Process Management Infrastructure Management • Automation/Virtualization • Availability • Security • Optimization • Provisioning • Policy-based Orchestration • Business Service Management • Resource Virtualization of Servers, Storage, Distributed Systems/Grid and the Network SOA Grid © 2004 IBM Corporation

  13. Web Services Evolution with SOA (Blank Page) © 2004 IBM Corporation

  14. UDDI Find Publish WSDL Service Bind Requestor SOAP What SOA (Service Oriented Architecture) is • SOA aims at realizing “plug-and-play” software component • Easy to connect and easy to disconnect • Consists of a collection of “services” and can communicate each other simply • A “service” is a function that is well-defined, self-contained, and does not depend on the context or state of other services. • Web Services as one of technology to realize • A set of architectural principles which address characteristics • Amazon and Google as early adopters © 2004 IBM Corporation

  15. Enterprise Service Bus Server Foundation Modeler Monitor BPEL Studio SOA Evolution • ESB as a design pattern for Services Orchestration • Total Application Lifecycle support for SOA • Transaction/Long Transaction needs © 2004 IBM Corporation

  16. Grid and Web Services Convergence (Blank Page) © 2004 IBM Corporation

  17. share manage access Resources on demand Applications on demand Global Accessibility Secure and universal access Business integration Vast resource scalability Grid Protocols Web Services Common Things for Web Services and Grid • Share, access, and manage IT resources from physical to logical over Internet • Grid mainly has focused on lower abstracted and dynamic resource like computing resources • Web Services have focused on higher abstracted and static resources like applications • OGSA as an convergence technology proposed in 2002 © 2004 IBM Corporation

  18. Applications OGSA Architected Services OGSI – Open Grid Services Infrastructure Web Services OGSA Enabled OGSA Enabled OGSA Enabled Network Storage Servers OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled Workflow Security Directory Messaging Database File Systems OGSI Issues as Web Services Technology • OGSI developed since 2002 as OGSA Foundation, but… • Too much stuff in one specification • Does not work well with existing Web Services and XML tooling • Too object oriented • Introduction of forthcoming WSDL 2.0 capability as unsupported extensions to WSDL 1.1 © 2004 IBM Corporation

  19. WS-Resource Properties WS-Resource Lifetime WS-Notification Modeling Stateful Resources with Web Services WS-Base Faults WS-Service Group WS-RenewableReferences Refactor OGSI into WSRF… • A family of Web services specification proposals in Jan, 2004 • Proposed by Globus, IBM, HP, et.al. • Refactor OGSI into WS-Resource Framework and WS-Notification • Introduces a design pattern to specify how to use Web services to access “stateful” components • Better separation of function and exploitation of other Web Services specification • Introduce message based publish-subscribe to Web services as a broader view of notification © 2004 IBM Corporation

  20. OGSI WS-Resource framework (WSRF) Grid Service Reference WS-Addressing Endpoint Reference Grid Service Handle WS-Addressing Endpoint Reference * HandleResolver portType WS-RenewableReferences Service data definition & access WS-ResourceProperties * * GridService lifetime mgmt WS-ResourceLifetime Notification portTypes WS-Notification Factory portType Treated as a pattern * ServiceGroup portTypes WS-ServiceGroup * Base fault type WS-BaseFaults Refactor OGSI into WSRF • Better separation of function and exploitation of other Web Services specification * Proposed as WSRF http://www.globus.org/wsrf/sabbah_wsrf.ppt © 2004 IBM Corporation

  21. Applications OGSA Architected Services Web Services (with WS-Resource Framework + WS-Notification) OGSA Enabled OGSA Enabled OGSA Enabled Network Storage Servers OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled OGSA Enabled Database Workflow Directory Security Messaging File Systems Web Services as OGSA Foundation • Grid applications will NOT require special Web services infrastructure • Grid Services as a part of Web Services Specification • Can use other Web Services standards naturally • Standard Web services development tools can be used © 2004 IBM Corporation

  22. Grid Services as Web Services Service Composition BPEL4WS WS-Notification WS-Service Group Quality of Experience (QoX) WS-Reliable Messaging WS-Transaction WS-Security WS-Resource Lifetime Description WS-Base Faults WS-Resource Properties XSD WSDL WS-Policy WS-Metadata Exchange Messaging SOAP XML WS-Addressing WS-Renewable References Transports JMS RMI / IIOP SMTP HTTP/HTTPS © 2004 IBM Corporation

  23. Adoption and Support for WSRF+ • Globus Alliance • Globus Toolkit 4.0 fully adopt WSRF expected to be shipped in 2005Q1 • IBM • IBM WebSphere Family and related Rational tools • When Standards mature they provide a runtime environment that supports WS-Resource Framework and WS-Notification • Fundamental to IBM’s On-Demand operating environment • System Management, Autonomic Computing • Data Management and Storage Management • Knowledge Management and Collaboration • Business Computing Services © 2004 IBM Corporation

  24. Adoption and Expansion of Grid Application (Blank Page) © 2004 IBM Corporation

  25. F1 m1, q1 f2 e NTCP SERVER NTCP SERVER NTCP SERVER f1, x1 F2 m1 = f1 f2 f2 f1 Experimental Model Experimental Model m1 Earthquake Simulation SIMULATION COORDINATOR U. Colorado UIUC m1 NCSA f2 f1 Computational Model Science: NEESgrid • Distributed Simulation of Building in Earthquake • Implemented with GT3 Grid Services • Collective use of distributed experiment facilities and computing resource • 10ms order for one time-step for each simulation calculation http://www.neesgrid.org/ © 2004 IBM Corporation

  26. Community Registry Mining Factory “Find me a data mining service, and somewhere to store data” Database Service Query BioDB 1 Miner “Create a data mining service with initial lifetime 10” Compute Service Provider . . . User Application . . . Results “Create a database with initial lifetime 1000” Query “I want to create a personal database containing data on e.coli metabolism” Database Service Database Factory “Notify User the mining done” Results BioDB n Database Storage Service Provider Science: Bioinformatics Data Mining • Potential OGSA Application Scenario in Science • Bioinformatics Data Mining Application Service • Can be a generic pattern for Data Mining services in enterprise • Multi-Provider involvement and long transaction to complete “Introduction to Open Grid Services Architecture (OGSA)” By Globus Project, 2002 © 2004 IBM Corporation

  27. Hospital : A Medical Grid Host E-chart system ③search MML Mr.X’s chart data repository ④search results Community Health Care Center Hospital : B Hospital:A Hospital:B Medical Grid Host ③search E-chart system broker functions ② ④search results Medical Grid Host ④　検索結果 MML Mr.X’s chart data Clinic : C XML Web Service Mr.X’s movie Web Service Client ⑴processing request Mr.X’s chart (Hospital : A) Search MML ① ⑤ Merge Mr.X’s chart information image encoding ASP Mr.X’s chart (Hospital : B) ASP Grid host Hospital : A Mr.X’s e-chart encoding system ⑥search results ⑶Result Hospital : B Mr.X’s e-chart ⑵notice of termination Hospital : A Mr.X’s operation / surgery movie Enterprise: Clinical Data Sharing Utility • Potential OGSA Application Scenario across Hospital • Experiment of virtual clinical data sharing and encoding capability using GT3 • Can be a generic pattern for virtual data utility services in enterprise • Developed by Partners of IBM Japan © 2004 IBM Corporation

  28. Enterprise: Dynamic Entertainment Service • GGF OGSA Use Case for Enterprise Service with Multiple Partners • Entertainment content provider and associated IT partner ecosystem • Content provision and aggregation like game and video contents • ex. Virtual Scuba-diving business scenario by Ian Foster • Tolerance to unexpected transaction fluctuation by dynamic Grid resource provisioning • Quick and dynamic ecosystem building using Standardized Grid Services Consumer Content Provider Content Provider Content Provider Integrator/ Publisher Infrastructure Service Provider Network Service Provider © 2004 IBM Corporation

  29. Summary (Blank Page) © 2004 IBM Corporation

  30. Summary • Next-Gen Applications in both Science and Enterprise need Dynamic and Flexible Grid Services • Dynamic multi-partnership needs in business and a complex research experiment/simulation • Unexpected transaction fluctuation especially in Enterprise • Long transaction needs with a long business process and a huge simulation/mining • Grid/Web Services Convergence with WSRF • Dynamic and flexible resource coordination • Single standardization for multiple partner collaboration • Loosely-coupled design based on SOA is key • Service virtualization for abstracted IT resource • Asynchronous aspects for long transaction © 2004 IBM Corporation

  31. © 2004 IBM Corporation

More Related