1 / 20

Euforia kick-off meeting 21-24 January 2008

Euforia kick-off meeting 21-24 January 2008. Overview of the Kepler platform B.Guillerminet on behalf of the ITM & ISIP teams (M.Airaj, P.Huynh, G.Huysmans, F.Iannone, F.Imbeaux, J.Lister, G.Manduchi, P Strand …). ITM Scope.

eaton-puckett
Download Presentation

Euforia kick-off meeting 21-24 January 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Euforia kick-off meeting 21-24 January 2008 Overview of the Kepler platformB.Guillerminet on behalf of the ITM & ISIP teams(M.Airaj, P.Huynh, G.Huysmans, F.Iannone, F.Imbeaux, J.Lister, G.Manduchi, P Strand …) Goteborg, Euforia Kick-off meeting 21-24 January 2008

  2. ITM Scope • KEPLER has been benchmarked and declared as the most appropriate Workflow Engine for the ITM (Integrated Tokamak Modelling) project. • Goal of the ITM: • Provide a comprehensive simulation package for ITER plasmas • Structure: • 7 sub-projects (IMP1..5 + ITER + ISIP) Goteborg, Euforia Kick-off meeting 21-24 January 2008

  3. Framework for the European Integrated Modelling • ISIP belongs to the European Integrated Tokamak Modelling project • 16 people, 7 laboratories • In charge of the infrastructure (soft + hard) for the ITM: • Code platform: framework, editor, … • Data handling: data structure, data storage & access, … • Tools: version handling, portal, … • Hardware: gateway, GRID/HPC, … Goteborg, Euforia Kick-off meeting 21-24 January 2008

  4. Architecture of the ITM code platform Portal more important in defining access to resources (certificates) Data access & application scheduling & Resource allocation through platform Visualization, monitoring & steering through platform “Gateway” Grid Workflow/ Code Platform Portal USER HPC Local Cluster Local Data Ext. Data ITM tools: standardized data structures, data access, interface definitions, Gateway (2008), Workflow (Kepler) Goteborg, Euforia Kick-off meeting 21-24 January 2008

  5. Principles • Standard naming, data structure • Share the names and tools • Validate its use for JET, TS, ASDEX, ITER • Currently, investigation for RT control of TS • Data access and storage: UAL • Available for “any” languages: C/C++, Fortran 90/95, Java, Matlab, Scilab, IDL, … => avoid problems of language mixing • Hide the data storage media: MDS+, HDF5, Database, … • Simulation • Workflow engine: based on KEPLER Goteborg, Euforia Kick-off meeting 21-24 January 2008

  6. Interfaces to Physics modules • Data exchange between different codes/modules will be based on the Universal Access Layer Goteborg, Euforia Kick-off meeting 21-24 January 2008

  7. What is KEPLER? • Design tool to compose a workflow • =>graphical: drag & drop the components (“actors”) • =>many actors: database, math, display, web service, grid service, R-expression, … • Engine to run a workflow • =>various model of computations (“directors”) • =>hierarchical design • Historical • Based on Ptolemy: C++ version (1996-) from UC Berkeley (A E Lee + many contributors) • Now Ptolemy II • Java version: UC San Diego Run control buttons Scheduler: time behavior Catalogues of components Goteborg, Euforia Kick-off meeting 21-24 January 2008

  8. Hierarchical design • Complex workflows • a complex workflow => composite actor • nested workflows Goteborg, Euforia Kick-off meeting 21-24 January 2008

  9. initialize() Iterations wrapUp() prefire fire() postfire() Actors/components • Orchestration of components • Java class (5 methods: init, prefire, fire, postfire, wrapup) • Init & wrapup are called once • Prefire, fire & postfire are called at each time step • A template is provided • Could be one call (launched at each time step) • Must be stored in a dedicated repertory • + a configuration file (XML) • Fusion requirements: • Not restricted to Java: • C/C++ • Fortran 77, 90/95, 2003 • Matlab • Scilab • … • Local or remote components • Codes must be independent of the workflow engine • =>Development of additional tools Goteborg, Euforia Kick-off meeting 21-24 January 2008

  10. Model of computations: directors • Data driven: • Dataflow oriented model • Modules are triggered by the data arrival • SDF (synchronous data flow) sequential execution • DDF (Parallel data flow) // execution • Message driven: • Message oriented model (network of processes) • Communication by passing messages through FIFO • PN (process networks) // execution • Time driven • Time-oriented models • DE (discrete event) • One global time • Events can be posted at some specific time • CT (Continuous Time) • Use to solve differential equations (integrator with feedback). • Implemented solvers: • Forward & backward Euler • 2(3)-order Runge-Kutta • Trapezoidal rule • Finite State Machine … many others directors DE CT Goteborg, Euforia Kick-off meeting 21-24 January 2008

  11. Mixing directors DE CT Goteborg, Euforia Kick-off meeting 21-24 January 2008

  12. Kepler • Running an example Goteborg, Euforia Kick-off meeting 21-24 January 2008

  13. Kepler • Building a workflow: • Drag and drop an actor from the catalogues • Define the input arguments: • And a display actor: • Specify the director Goteborg, Euforia Kick-off meeting 21-24 January 2008

  14. Code integration • =>one-click integration of C/C++, Fortran local codes • GUI tool: define the arguments • JNI based • =>one-click integration of C/C++, Fortran remote codes • GUI tool: define the arguments • Automatic generation of Web Services based on gSOAP • =>one-click catalogue insertion • GUI tool • XML based Goteborg, Euforia Kick-off meeting 21-24 January 2008

  15. Plot 2D Plot 3D in-memory Data server SOLOVIEV HELENA MISHKA Goteborg, Euforia Kick-off meeting 21-24 January 2008

  16. KEPLER enhancements (cont’d) • Visualization: • =>2D, 3D data plots • Actors • VTK based • =>Meshing • Delaunay 2D & 3D Goteborg, Euforia Kick-off meeting 21-24 January 2008

  17. KEPLER enhancements (cont’d) • Post-processing: • =>Scilab • Signal processing, non-linear control, … • Data analysis • Visualization • =>Implementation • Scilab expression • Numerical actors Goteborg, Euforia Kick-off meeting 21-24 January 2008

  18. KEPLER enhancements (cont’d) Examples (Scilab) Goteborg, Euforia Kick-off meeting 21-24 January 2008

  19. Job transfer via FTP Data transfer via FTP Job scheduling via JCL Proxy GRID-EGEE Fusion V.O. • GLOBUS • =>C/C++ library • =>Java library in development • GLITE • =>Java library in development • ITM • =>Codes as WS • =>UAL data access Goteborg, Euforia Kick-off meeting 21-24 January 2008

  20. References • Tutorial, download … • Ptolemy II Design documents • Vol 1 user oriented, Vol 2 developper oriented, Vol 3 researcher oriented • http://www.kepler-project.org/ • http://kepler.ecoinformatics.org/ • The Kepler Collaboration • SEEK: Science Environment for Ecological Knowledge • SDM Center: SDM center process automation • GEON: Geosciences • ROADNet: Real time Observatories • EOL: Encyclopedia of Life • CIPRES: Phylogenetic Research • REAP: Realtime Environment for Analytic Processing • CPES: Center for Plasma Edge Simulation/Studies Goteborg, Euforia Kick-off meeting 21-24 January 2008

More Related