1 / 79

Denis Caromel Scientific Coordinator Denis.Caromel@inria.fr Beijing, October 2007

Denis Caromel Scientific Coordinator Denis.Caromel@inria.fr Beijing, October 2007. Overview of. GCM Partners. GCM: Grid Component Model GCM Being defined in the NoE CoreGRID (42 institutions) Open Source ObjectWeb Pro Active implements a preliminary version of GCM

ford
Download Presentation

Denis Caromel Scientific Coordinator Denis.Caromel@inria.fr Beijing, October 2007

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Denis CaromelScientific CoordinatorDenis.Caromel@inria.frBeijing, October 2007 Overview of

  2. GCM Partners Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  3. GCM: Grid Component Model • GCM Being defined in the NoE CoreGRID (42 institutions) • Open Source ObjectWebProActive implements a preliminary version of GCM • Service Oriented: NESSI relation • GridCOMP takes: • GCM as a first specification, • ProActive as a starting point, and Open Source reference implementation. The vision: GCM to be the GRID GSM Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  4. GSM and GCM Pictures • GSM cells: • Components: Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  5. GSM and GCM Pictures: Europe Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  6. GSM and GCM Pictures: China and Asia Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  7. Melbourne Nancy Metz Napoli ETSI Grid Plugtests, 04, 05, 06, 07 Amsterdam Belfast Fribourg Grenoble Lille Manchester Melbourne Merida Metz Bombay Nancy Napoli Nice Metz Paris Pise Rennes Santiago San Diego Beijing Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  8. Overview of Project Objectives: GRID PROGRAMMING WITH COMPONENTS: AN ADVANCED COMPONENT PLATFORM FOR AN EFFECTIVE INVISIBLE GRID • Interoperability Objectives: • Interoperability with other standards: EGEE gLite, UNICORE, NorduGrid, Globus, Web Services, LSF, IBM LL, SGE, CGSP China Grid, etc., • A GCM ETSI Official Public Standard Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  9. WP 2:Component Framework Implementation

  10. GCM + Scopes and Objectives: Grid Codes that Compose and Deploy No programming, No Scripting, … No Pain Innovation: Composite Components Multicast and GatherCast MultiCast GatherCast

  11. ProActive / GCM Environment Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  12. WP 3: Non Functional Component Features

  13. WP3 - Non Functional Component Features • A “framework” for autonomic management of components • Design of the manager structure • Definition of proper implementation mechanisms • Characterisation of properties handled through autonomic managers • Preliminary experiments on parallel component compositions • Autonomic management of simple performance contracts • Assessment of the autonomic framework features • Layered design of non functional component features • Identify proper mechanisms to handle dynamic adaptation of components • Define local strategies to achieve contractually specified QoS goals • Define orchestration strategies preserving local to global effect • Interaction with use cases to assess/improve NF framework Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  14. WP 4: Grid IDE for Programmers and Composers

  15. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  16. WP4 - Grid IDE for Programmers and Composers • Provides an integrated programming and composing GUI • Offers facilities to bind both normal code and legacy code into primitive components • Enables assembly of Grid applications • Provides launcher tools for the deployment of a component application • Offers a steering tool for installing, removing, and re-installing new versions of component code • Provides a tool for the monitoring of resources Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  17. Component GUI under Dev. at Westminster Univ. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  18. WP 5: Usecases

  19. WP5 – Use cases • Three main partners: IBM, Atos Origin, GridSystems • Four use cases: • Biometric Identification System (IBM) • Identify people solely on their biometric information (1:N match) • Management Application – Computing of DSO value (ATOS) • Days Sales Outstanding is the mean time that clients delay to pay an invoice to an company • Telecom – EDR Processor (GS) • Aerospace – Wing Design (GS) • computes the aerodynamic wing performance for a given configuration, using a legacy fortran-77 app Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  20. GCM Interoperability Deployment • Dynamicity, Autonomicity, SOA integration • Full-fledged Environment: Conclusion:

  21. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  22. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  23. ETSI GCM TC Grid Standard Work Item No 1 • GCM Interoperability Deployment • GCM Application Description • GCM Fractal ADL (Architecture Description Language) • GCM Management (Java, C, WSDL API) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  24. GSM and GCM Pictures • GSM cells: • Components: Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  25. GSM and GCM Pictures Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  26. GSM and GCM Pictures Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  27. GridCOMP and SOA Components:  The binding is achieved at deployment, statically. Services:  a new binding can occur at each invocation, depending of SLA, conditions, etc. What we aime at in GridCOMP: A Cp system with dynamic reconfiguration including new bindings Dynamic Dispatch Multicast, Autonomicity, Reconfiguration Other relations to SOA: Register and Lookup ESB Code provisioning Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  28. GCM Interoperability Deployment • Dynamicity, Autonomicity, SOA integration • Full-fledged Environment: Conclusion:

  29. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  30. Components and SOA • Definition: • Components: Binding at configuration and deployment • Services and SCA: Binding potentially at each call • In GridCOMP: • Autonomicity, Reconfiguration • Lookup, Dynamic Bindings, etc. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  31. ProActive/GCM Component Definition • A component: • Is formed from one (or several) Active Object • Is executed on one (or several) JVM • Provides a set of server ports: Java Interfaces • Uses a set of client ports: Java Attributes • Uses Point-to-point or Group communication between components • Hierarchical: • Primitive component: define with Java code and a descriptor • Composite component: calls in composites • Descriptor: composition of primitive + composite • Parallel component: multicast of • XML definition of primitive and composite (ADL) • Virtual nodes capture the deployment capacities and needs • Virtual Node is a very important abstraction for GRID components Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  32. GCM Architecture Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  33. GCM Technical Structure • Component Specification as an XML schema or DTD • Run-Time API defined in several languages C, Java • Description and Information for Deployment (XML DD, Virtual Nodes, File Transfer, …) • Packaging described as an XML schema Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  34. Main Technical Activities --- Objectives • WP 2, Task 2.1: Primitive Component Programming • WP 2, Task 2.2: Legacy Code Wrapping, Interoperability • WP 2, Task 2.3: Composition, Composite, and Deployment For memory: • Autonomic features (WP 3) • IDE for GCM, Composition GUI (WP 4) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  35. Collective Interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  36. Collective Interfaces • Simplify the design and configuration of component systems • Expose the collective nature of interfaces • Cardinality attribute • Multicast, Gathercast, gather-multicast • The framework handles collective behaviour at the level of the interface • Based on Fractal API : • Dedicated controller • Interface typing  Verifications Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  37. Multicast interfaces Transform a single invocation into a list of invocations • Multiple invocations • Parallelism • Asynchronism • Dispatch • Data redistribution (invocation parameters) • Parameterisable: Distribution Function • Broadcast, scattering • Dynamic redistribution: Dynamic dispatch • Result = list of results Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  38. Multicast interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  39. Multicast interfaces • Results as lists of results • Invocation parameters may also be distributed from lists Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  40. Transform: a list of invocations   a single invocation Synchronization of incoming invocations ~ “join” invocations Timeout / Drop policy Bidirectional Bindings (callers  callee) Data gathering Aggregation of parameters into lists Result: Redistribution of results Redistribution function Gathercast interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  41. Status of GCM in ProActive • Partial implementation: • ADL schema, API, Multicast, Gathercast, … • Component GUI (prototype) • Distributed components for various applications: • Numerical, Legacy, … • Achieved experiments: • A component application on up to 300+ CPUs Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  42. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  43. IC2D and Generic EnvironmentEclipse GUI Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  44. Prototype : GUI for Components Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  45. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  46. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  47. TimIt Automatic Timers in IC2D Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  48. ProActive / GCM Environment Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  49. Current GCM experiments in ProActive • JEM3D: 3D electromagnetic application: a single Cp on 300+ CPUs on Grid • Vibro-Acoustic application with EADS (legacy MPI coupling) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  50. Scheduler: User Interface Grid programming with components: an advanced COMPonent platform for an effective invisible grid

More Related