1 / 58

devoxx

www.devoxx.com. Clouds. 3 Speakers/Demos. Florin Alexandru Bratu (Romania). Denis Caromel (France, Nice). Franca Perrina (Italy). www.devoxx.com. 3 Strong Faiths. Parallel Computing will make it mainstream with Java A need for a unified Parallel Abstraction:

cecily
Download Presentation

devoxx

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Denis Caromel

  2. Denis Caromel www.devoxx.com

  3. Clouds Denis Caromel

  4. 3 Speakers/Demos Florin Alexandru Bratu (Romania) Denis Caromel (France, Nice) Franca Perrina (Italy) Denis Caromel www.devoxx.com

  5. 3 Strong Faiths • Parallel Computing will make it • mainstream with Java • A need for a unified Parallel Abstraction: • Multi-Core + Distributed • 3. Java will make it possible to connect • Enterprise Grids and Clouds Denis Caromel

  6. Effective SOA + GRIDs with • Background: INRIA, OASIS, ActiveEon • Programming, Optimizing • 3. Scheduling • 4. SOA:WS, WSDL, BPEL (Franca Perrina) • 5. Enterprise Grids, Clouds: Amazon EC2 • 6. Java EE EJB (Florin Alexandru Bratu) Agenda Denis Caromel

  7. 1. Background Denis Caromel

  8. Computer Science and Control 8 Centers all over France Workforce: 3 800 Strong in standardization committees: IETF, W3C, ETSI, … Strong Industrial Partnerships Foster company foundation: 90 startups so far - Ilog (Nasdaq, Euronext) - … - ActiveEon OASIS Team & INRIA • A joint team between: INRIA, Nice Univ. CNRS • Now about 40 persons • 2004: First ProActive User Group • 2008: 5th one, Acad./Indus. User Presentations • ProActive 4.0.1: Distributed and Parallel: • From Multi-cores to Enterprise GRIDs Denis Caromel

  9. Startup Company Born of INRIA • Co-developing, Providing support for Open Source ProActive Parallel Suite • Worldwide Customers (EU, Boston USA, etc.) Denis Caromel

  10. 2. Programming Optimizing Parallel Acceleration Toolkit in Java:Parallelism: Multi-Core+Distributed Used in production by industry Denis Caromel

  11. Denis Caromel

  12. Denis Caromel

  13. ProActive Parallel Suite Denis Caromel

  14. ProActive Parallel Suite Denis Caromel

  15. Distributed and ParallelActive Objects 15 Denis Caromel

  16. ProActive : Active objects JVM A A WBN! A ag =newActive (“A”, […], VirtualNode) V v1 = ag.foo (param); V v2 = ag.bar (param); ... v1.bar(); //Wait-By-Necessity JVM ag v2 v1 V Wait-By-Necessity is a Dataflow Synchronization Java Object Active Object Req. Queue Future Object Proxy Thread Request 16 Denis Caromel

  17. Standard system at Runtime:No Sharing NoC: Network On Chip Proofs of Determinism 17 Denis Caromel

  18. TYPED ASYNCHRONOUS GROUPS 18 Denis Caromel

  19. Creating AO and Groups A V A ag =newActiveGroup (“A”, […], VirtualNode) V v = ag.foo(param); ... v.bar(); //Wait-by-necessity JVM Group, Type, and Asynchrony are crucial for Composition Typed Group Java or Active Object 19 Denis Caromel

  20. Broadcast and Scatter ag JVM c3 c3 c3 c3 c3 c3 c3 c1 c1 c1 c1 c1 c1 c1 c2 c2 c2 c2 c2 c2 c2 JVM JVM s s JVM • Broadcast is the default behavior • Use a group as parameter, Scattered depends on rankings cg ag.bar(cg); // broadcast cg ProActive.setScatterGroup(cg); ag.bar(cg); // scatter cg 20 Denis Caromel

  21. Optimizing 21 Denis Caromel

  22. Denis Caromel

  23. Denis Caromel

  24. IC2D Denis Caromel

  25. ChartIt Denis Caromel

  26. Pies for Analysis and Optimization Denis Caromel

  27. Video 1: IC2D OptimizingMonitoring, Debugging, Optimizing Denis Caromel

  28. 3. Scheduling 28 Denis Caromel

  29. Denis Caromel

  30. Scheduler and Resource Manager:User Interface Denis Caromel

  31. Scheduler: User Interface Denis Caromel

  32. Video 2:Scheduler, Resource Manager Denis Caromel

  33. 4. SOA Integration:Web Services, BPEL Workflow Franca Perrina OASIS Team - INRIA Denis Caromel

  34. Active Objects as Web Services JVM • Why ? • Access Active Objects from any language • How ? • HTTP Server • SOAP Engine (Axis) • Usage: Web Services ProActive.exposeAsWebService(); ProActive.unExposeAsWebService(); Web Service Client Denis Caromel

  35. ProActive + Services + WorkflowsPrinciples:3 kinds of Parallel Services • 3. Domain Specific Parallel Services • (e.g. Monte Carlo Pricing) • 2. Typical Parallel Computing Services • (Parameter Sweeping, D&C, …) • Basic Job Scheduling Services • (parallel execution on the Grid) Denis Caromel

  36. 3. Domain Specific Parallel Service Other Basic Service 2. Parameter Sweeping Service Other Operational Service High level Business Process Domain Specific Parallel Service 1. Job Scheduling Service 2. Divide & Conquer Service 3 kinds of Parallel Services • 3. Domain Specific Parallel • Services: • providing business • functionalities executed in • parallel • 2. Parallelization services: • typical parallel computing • patterns (Parameter • Sweeping, D&C, …) • 1. Job Scheduling service: • Schedule and Run jobs in • parallel on the Grid. … … … Operational Services Parallel Services Grid Denis Caromel

  37. PA Scheduler & PA Resource Manager A sample pattern: Parameter Sweeping Process using parameter sweeping service O1 O2 … On I1 I2 … In Param Sweeping Service parameter sweeping I1 I2 … In O1 O2 … On All the running instances of the Exec logic X are executed on the grid as a whole Parameter Sweeping Service, customized with an Exec logic X Exec Logic … Denis Caromel

  38. Demo SOA Integration:Web Services, BPEL Workflow Denis Caromel

  39. 5. Enterprise Grids, Clouds: Standards &Amazon EC2 39 Denis Caromel

  40. Large Equipment Internet Internet Internet Internet Servlets EJBs Databases Job management for embarrassingly parallel application (e.g. SETI) Parallel Machine Clusters Deploy on Various Kinds of Infrastructures Denis Caromel

  41. GCM Fractal StandardizationFractal BasedGrid Component Model • Overall, the standardization is supported by industrials: • BT, FT-Orange, Nokia-Siemens, Telefonica, • NEC, Alcatel-Lucent, Huawei … Denis Caromel

  42. Protocols and Scheduler inGCM Deployment Standard • Protocols: • Rsh, ssh • Oarsh, Gsissh • Scheduler, and Grids: • GroupSSH, GroupRSH, GroupOARSH • ARC (NorduGrid), CGSP China Grid, EEGE gLITE, • Fura/InnerGrid (GridSystem Inc.) • GLOBUS, GridBus • IBM Load Leveler, LSF, Microsoft CCS (Windows HPC Server 2008) • Sun Grid Engine, OAR, PBS / Torque, PRUN • Soon available in stable release: • Java EE • Amazon EC2 Denis Caromel

  43. 6. J2EE Integration Florin Alexandru Bratu OASIS Team - INRIA Denis Caromel

  44. J2EE Integration with Parallelism + Grids/Clouds Performing Grid & Cloud Computing From & In an Application Servers Delegating heavy computations outsides J2EE Applications Using Deployed J2EE Nodes as Computational Resources Denis Caromel

  45. ProActive – J2EE Integration (1) • Delegating heavy computations outsides J2EE Applications Denis Caromel

  46. ProActive – J2EE Integration (2) 2. Using Deployed J2EE Nodes as Computational Resources • Objective • Being able to deploy active objects inside the JVMs of application servers • Implementation • Based on a Sun standard – Java Connector Architecture JSR112 • Deployment module: resource adapter (RAR)‏ • Works with all J2EE-compliant Application Servers Denis Caromel

  47. Integration(2)‏

  48. Grids & Clouds:Amazon EC2 Deployment Denis Caromel

  49. Big Picture + Clouds Denis Caromel

  50. Clouds: ProActive Amazon EC2 Deployment • Principles & Achievements: • ProActive Amazon Images (AMI) on EC2 • So far up to 128 EC2 Instances • (Indeed the maximum on the EC2 platform, … ready to try 4 000 AMI) • Seamless Deployment: • no application change, no scripting, no pain • Open the road to : In house Enterprise Cluster and Grid + Scale out on EC2 Denis Caromel

More Related