Denis Caromel Scientific Coordinator Denis.Caromel@inria.fr Beijing, October 2007

1. Denis CaromelScientific CoordinatorDenis.Caromel@inria.frBeijing, October 2007 Overview of

2. GCM Partners Grid programming with components: an advanced COMPonent platform for an effective invisible grid

3. GCM: Grid Component Model • GCM Being defined in the NoE CoreGRID (42 institutions) • Open Source ObjectWebProActive implements a preliminary version of GCM • Service Oriented: NESSI relation • GridCOMP takes: • GCM as a first specification, • ProActive as a starting point, and Open Source reference implementation. The vision: GCM to be the GRID GSM Grid programming with components: an advanced COMPonent platform for an effective invisible grid

4. GSM and GCM Pictures • GSM cells: • Components: Grid programming with components: an advanced COMPonent platform for an effective invisible grid

5. GSM and GCM Pictures: Europe Grid programming with components: an advanced COMPonent platform for an effective invisible grid

6. GSM and GCM Pictures: China and Asia Grid programming with components: an advanced COMPonent platform for an effective invisible grid

7. Melbourne Nancy Metz Napoli ETSI Grid Plugtests, 04, 05, 06, 07 Amsterdam Belfast Fribourg Grenoble Lille Manchester Melbourne Merida Metz Bombay Nancy Napoli Nice Metz Paris Pise Rennes Santiago San Diego Beijing Grid programming with components: an advanced COMPonent platform for an effective invisible grid

8. Overview of Project Objectives: GRID PROGRAMMING WITH COMPONENTS: AN ADVANCED COMPONENT PLATFORM FOR AN EFFECTIVE INVISIBLE GRID • Interoperability Objectives: • Interoperability with other standards: EGEE gLite, UNICORE, NorduGrid, Globus, Web Services, LSF, IBM LL, SGE, CGSP China Grid, etc., • A GCM ETSI Official Public Standard Grid programming with components: an advanced COMPonent platform for an effective invisible grid

9. WP 2:Component Framework Implementation

10. GCM + Scopes and Objectives: Grid Codes that Compose and Deploy No programming, No Scripting, … No Pain Innovation: Composite Components Multicast and GatherCast MultiCast GatherCast

11. ProActive / GCM Environment Grid programming with components: an advanced COMPonent platform for an effective invisible grid

12. WP 3: Non Functional Component Features

13. WP3 - Non Functional Component Features • A “framework” for autonomic management of components • Design of the manager structure • Definition of proper implementation mechanisms • Characterisation of properties handled through autonomic managers • Preliminary experiments on parallel component compositions • Autonomic management of simple performance contracts • Assessment of the autonomic framework features • Layered design of non functional component features • Identify proper mechanisms to handle dynamic adaptation of components • Define local strategies to achieve contractually specified QoS goals • Define orchestration strategies preserving local to global effect • Interaction with use cases to assess/improve NF framework Grid programming with components: an advanced COMPonent platform for an effective invisible grid

14. WP 4: Grid IDE for Programmers and Composers

15. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

16. WP4 - Grid IDE for Programmers and Composers • Provides an integrated programming and composing GUI • Offers facilities to bind both normal code and legacy code into primitive components • Enables assembly of Grid applications • Provides launcher tools for the deployment of a component application • Offers a steering tool for installing, removing, and re-installing new versions of component code • Provides a tool for the monitoring of resources Grid programming with components: an advanced COMPonent platform for an effective invisible grid

17. Component GUI under Dev. at Westminster Univ. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

18. WP 5: Usecases

19. WP5 – Use cases • Three main partners: IBM, Atos Origin, GridSystems • Four use cases: • Biometric Identification System (IBM) • Identify people solely on their biometric information (1:N match) • Management Application – Computing of DSO value (ATOS) • Days Sales Outstanding is the mean time that clients delay to pay an invoice to an company • Telecom – EDR Processor (GS) • Aerospace – Wing Design (GS) • computes the aerodynamic wing performance for a given configuration, using a legacy fortran-77 app Grid programming with components: an advanced COMPonent platform for an effective invisible grid

20. GCM Interoperability Deployment • Dynamicity, Autonomicity, SOA integration • Full-fledged Environment: Conclusion:

21. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

22. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

23. ETSI GCM TC Grid Standard Work Item No 1 • GCM Interoperability Deployment • GCM Application Description • GCM Fractal ADL (Architecture Description Language) • GCM Management (Java, C, WSDL API) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

24. GSM and GCM Pictures • GSM cells: • Components: Grid programming with components: an advanced COMPonent platform for an effective invisible grid

25. GSM and GCM Pictures Grid programming with components: an advanced COMPonent platform for an effective invisible grid

26. GSM and GCM Pictures Grid programming with components: an advanced COMPonent platform for an effective invisible grid

27. GridCOMP and SOA Components:  The binding is achieved at deployment, statically. Services:  a new binding can occur at each invocation, depending of SLA, conditions, etc. What we aime at in GridCOMP: A Cp system with dynamic reconfiguration including new bindings Dynamic Dispatch Multicast, Autonomicity, Reconfiguration Other relations to SOA: Register and Lookup ESB Code provisioning Grid programming with components: an advanced COMPonent platform for an effective invisible grid

28. GCM Interoperability Deployment • Dynamicity, Autonomicity, SOA integration • Full-fledged Environment: Conclusion:

29. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

30. Components and SOA • Definition: • Components: Binding at configuration and deployment • Services and SCA: Binding potentially at each call • In GridCOMP: • Autonomicity, Reconfiguration • Lookup, Dynamic Bindings, etc. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

31. ProActive/GCM Component Definition • A component: • Is formed from one (or several) Active Object • Is executed on one (or several) JVM • Provides a set of server ports: Java Interfaces • Uses a set of client ports: Java Attributes • Uses Point-to-point or Group communication between components • Hierarchical: • Primitive component: define with Java code and a descriptor • Composite component: calls in composites • Descriptor: composition of primitive + composite • Parallel component: multicast of • XML definition of primitive and composite (ADL) • Virtual nodes capture the deployment capacities and needs • Virtual Node is a very important abstraction for GRID components Grid programming with components: an advanced COMPonent platform for an effective invisible grid

32. GCM Architecture Grid programming with components: an advanced COMPonent platform for an effective invisible grid

33. GCM Technical Structure • Component Specification as an XML schema or DTD • Run-Time API defined in several languages C, Java • Description and Information for Deployment (XML DD, Virtual Nodes, File Transfer, …) • Packaging described as an XML schema Grid programming with components: an advanced COMPonent platform for an effective invisible grid

34. Main Technical Activities --- Objectives • WP 2, Task 2.1: Primitive Component Programming • WP 2, Task 2.2: Legacy Code Wrapping, Interoperability • WP 2, Task 2.3: Composition, Composite, and Deployment For memory: • Autonomic features (WP 3) • IDE for GCM, Composition GUI (WP 4) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

35. Collective Interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

36. Collective Interfaces • Simplify the design and configuration of component systems • Expose the collective nature of interfaces • Cardinality attribute • Multicast, Gathercast, gather-multicast • The framework handles collective behaviour at the level of the interface • Based on Fractal API : • Dedicated controller • Interface typing  Verifications Grid programming with components: an advanced COMPonent platform for an effective invisible grid

37. Multicast interfaces Transform a single invocation into a list of invocations • Multiple invocations • Parallelism • Asynchronism • Dispatch • Data redistribution (invocation parameters) • Parameterisable: Distribution Function • Broadcast, scattering • Dynamic redistribution: Dynamic dispatch • Result = list of results Grid programming with components: an advanced COMPonent platform for an effective invisible grid

38. Multicast interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

39. Multicast interfaces • Results as lists of results • Invocation parameters may also be distributed from lists Grid programming with components: an advanced COMPonent platform for an effective invisible grid

40. Transform: a list of invocations   a single invocation Synchronization of incoming invocations ~ “join” invocations Timeout / Drop policy Bidirectional Bindings (callers  callee) Data gathering Aggregation of parameters into lists Result: Redistribution of results Redistribution function Gathercast interfaces Grid programming with components: an advanced COMPonent platform for an effective invisible grid

41. Status of GCM in ProActive • Partial implementation: • ADL schema, API, Multicast, Gathercast, … • Component GUI (prototype) • Distributed components for various applications: • Numerical, Legacy, … • Achieved experiments: • A component application on up to 300+ CPUs Grid programming with components: an advanced COMPonent platform for an effective invisible grid

42. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

43. IC2D and Generic EnvironmentEclipse GUI Grid programming with components: an advanced COMPonent platform for an effective invisible grid

44. Prototype : GUI for Components Grid programming with components: an advanced COMPonent platform for an effective invisible grid

45. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

46. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

47. TimIt Automatic Timers in IC2D Grid programming with components: an advanced COMPonent platform for an effective invisible grid

48. ProActive / GCM Environment Grid programming with components: an advanced COMPonent platform for an effective invisible grid

49. Current GCM experiments in ProActive • JEM3D: 3D electromagnetic application: a single Cp on 300+ CPUs on Grid • Vibro-Acoustic application with EADS (legacy MPI coupling) Grid programming with components: an advanced COMPonent platform for an effective invisible grid

50. Scheduler: User Interface Grid programming with components: an advanced COMPonent platform for an effective invisible grid