210 likes | 397 Views
Grid Computing at Intel c urrent Status and Outlook. Ralf Ratering Senior Software Engineer Intel Parallel and Distributed Solutions Division (PDSD). Agenda. What is the Grid? Overview of Grid Community A real-world example: UNICORE Outlook on Grid Programming Environment.
E N D
Grid Computing at Intelcurrent Status and Outlook Ralf Ratering Senior Software Engineer Intel Parallel and Distributed Solutions Division (PDSD)
Agenda • What is the Grid? • Overview of Grid Community • A real-world example: UNICORE • Outlook on Grid Programming Environment
What is the Grid? sharing distributed resources single sign-on security The Grid is a new infrastructure that addresses the industry`s need for computing power and data storage. reliability load balancing open standards hardware& software
The Grid Community Grid End Users Grid Solutions Enterprise Grid Alliance (EGA), Globus Alliance, IBM, HP, Platform, etc. Grid Building Blocks Intel, Globus Toolkit, UNICORE, Platform, Oracle, DataSynapse, IBM, HP, Dell, etc. Grid Standards Global Grid Forum (GGF), W3C, IETF, OASIS, etc. *Other names and brands may be claimed as the property of others
Grid Software Taxonomy Grid Software Development Applications Middleware Tools Userware Science Enterprise Collaboration Globus UNICORE Legion Cactus LSF PBSPro SGE Condor ... HE Physics Biology Chemistry Meteorology CFD FEA ... Web Services HPC Grid Tools CA Tools ... Oracle 10g United Devices DataSynapse Avaki Platform ... Access Grid Web Portals Client Apps ... *Names and brands may be claimed as the property of others
SOA Service Oriented Architecture (SOA) SOA is the Grand Synthesis Grid Computing (scheduling and coordinating multiple/diverse compute and information resources) Virtualization (aggregation, and physical:logical mgnt) Web Services (std app interaction, publish, discover, invoke) Utility Computing (metering, accounting, billing) P2P (Internet edge-resource interaction) Autonomic Computing (self-aware, self-optimizing, self-healing, self-managing) “The Insight Research Corporation, Grid Computing: a Vertical Market Perspective 2003-2008”
Applications Open Grid Service Architecture OGSA WS Resource Framework WSRF Web Services OGSA enabled Server Components Grid Standards The Grid will not succeed without open standards defined by the community Wrappers around existing applications or completely new Grid applications Define which Grid Services and functionalities are needed Mechanisms to manage Grid Services Messaging, security, transport, tooling Interface to different servers, storages or networks
UNICORE Grid Computing is real and available now! • UNICORE connects Supercomputers and Clusters to a Computing Grid • Developed in German research projects by Pallas (now Intel PDSD) and Fujitsu • Heavily used in European and Asian Grid projects • Available as Open Source from UNICORE Forum (www.unicore.org)
SSL INTRANET INTRANET Firewall Firewall Gateway Gateway ... Network Job Supervisor (NJS) Target System Interface Firewall Firewall User Database Incarnation Database UNICORE Architecture in a Nutshell Specify platform- independent job signed with user certificate Client Gateway Adresses XML File Firewall INTERNET Run platform specific script Certificate-Login Mapping Platform-specific information
Intel PDSD Grid Nizhny Novgorod, Russia Champaign, Illinois 4 Node Xeon™ Cluster 4 Node Xeon™ Cluster 4 Node Xeon™ Cluster Cologne, Germany 2 Node Xeon™ Cluster 4 x Itanium® 2 DEMO
Applications High Level Grid API GPE Language independent definition Open Grid Service Architecture OGSA WS Resource Framework WSRF Java reference implementation Web Services OGSA enabled Server Components The next step:Grid Programming Environment (GPE) Bringing applications to the Grid... Visual Grid SDK GridBeans Client Framework Grid Programming Language
Use Case: Expert User Grid Application GS Grid Client • Run multiple applications in complex workflows • Get all information from the Grid Broker GS WSRF Application GS Application Grid Service Database GS Information GS User Keystore Fully-fledged Java Application
Use Case: Application User Grid Application Client • Only one application • Get only application specific information • Run lightweight client on mobile devices Application Grid Service WSRF User Certificate Lightweight Java Application
Use Case: Unaware User User DB Authenticate using server certificate Web Browser • What is a "Grid"? • Service provider offers a service on the web JSP Grid Server Application Grid Service Register WSRF Request/ Response Server Certificate Service Provider Presentation oriented user interface User
Deploy Deploy G-API Application GS Application Plug-in WSRF The Grid Developer Grid Visual Grid SDK Application GS • GridBean=Grid Service+Client Plug-in • Wrap existing applications • Write new Grid applications • Plug-in for Eclipse Information GS Web Client Database GS Application Client Broker GS Grid Client
Grid Service Backends UNICORE Network Job Supervisor • GPE will provide Grid services to wrap different server types UNICORE GS Globus Job Manager Globus GS Application GS WSRF Native Protocols Condor DRMAA GS Sun Grid Engine
GPE: The Big Picture Visual Grid SDK Eclipse Plugin Deploy Plug-Ins Developer Workstation Deploy GS Grid Client Plugins Plugins G-API Plug-Ins Grid Keystore Application GS User Workstation UNICORE Application Client Database GS WSRF Broker GS Plug-In G-API Globus User Certificate Mobile Device Application GS DRMAA Application Service Web Client JSP Information GS Plug-In G-API Web Browser Service Certificate Service Provider
Intel Development Tools GPE Intel already has industry leading node tools Engage here Enhancing here
Summary • The Grid is a new infrastructure that addresses the industries need for computing power and interoperability • It will not succeed without open standards defined by the community • Grid Computing is real and available now! • Download at www.unicore.org • The Grid Programming Environment (GPE) enables developers to deploy applications on the Grid
Passes through firewalls HTTPS Request UNICORE Job GSFactory Handles Gateway Service Handle Service Factory Registry Gateway Service Service Factory Register Create OGSI Client Using Grid Services in UNICORE Registry Handle XML File UNICORE Server