1 / 26

Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure

Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure. Bartek Palak bartek@man.poznan.pl Poznan Supercomputing and Networking Center. Outline. JRA activity of BalticGrid-I Recommendation from BG-I final review JRA activity description Objectives

lulu
Download Presentation

Joint Research Activity Enhanced Application Services on Sustainable e-Infrastructure

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Joint Research ActivityEnhanced Application Services on Sustainable e-Infrastructure Bartek Palak bartek@man.poznan.pl Poznan Supercomputing and Networking Center

  2. Outline • JRA activity of BalticGrid-I • Recommendation from BG-I final review • JRA activity description • Objectives • Description of tasks • Summary of work done • Plans for the next period • Conclusions 2

  3. JRA activity of BalticGrid-I Account Service Level Agreement Markets and Dynamic Account Management • Partners: EENet, IMCS UL, KTH, PSNC, VU • Objectives • Investigate, prototype mechanisms for SLA security and enforcement • Design and develop account management system • Development of products: • VUS – Virtual User System • DGAS - Distributed Grid Accounting System • Tycoon – approach for better Service Level Agreement (SLA) • Outcome • VUS and DGASproved its quality by running on production sites. • Several insurmountable issues have been found with the Tycoon system • Unreliable tool, HP changed the policy, no open source any more • The decision of BG is not to use this system due to this issues 3

  4. Recommendations from BG-I final review Recommendations: the consortium will need to provide end-users with the necessary capabilities to use the grid infrastructure effectively […] following on from the above point, JRA1 and related work are going to become increasingly important and the reviewers recommend that the consortium should continue work in this area in future projects; Recommendations implementation: Activity focuses on providing services enabling efficient and intuitive usage of Grid resources 4

  5. JRA Activity • 7% of project resources • 31,5 PMs • Partners • Vilnius University • Vilnius Gediminas Technical Univeristy • University Poznan Supercomputing and Networking Center (coordination)

  6. Objectives • Extending the e-Infrastructure with advanced services necessary from the user, application and administrator point of view - the GUI level • Enhancements of existing services enabling user-friendly and intuitive access to Grid environment • Providing support forthe new research communities well defined in NA3 (Application Identification and Collaboration) and supported by SA3 (Application Integration and Support)

  7. Description of tasks • Providing user-level support for Grid advanced data management • Adaptation of task flow definition and management mechanisms • Providing visualization tools for scientific computing in Grid • Development of a user-friendly environment used for cooperation of user groups and applications A clear vision of components development: • Migrating Desktop advanced grid interface • Visualisation of specific computing results • Gridcom groupware

  8. MJRA1.1Design phase closed(1) Design phase closed (MJRA1.1) Definition of works planned within activity Establishing co-operation rules Definition of relations to other activities Design of development directions Performance analysis of visualization tools in GRIDenvironment Deployment of existing data visualization tools Visualization toolkit VTK 5.0.3 Turnkey package ParaView 3.2.1 (based on VTK) Visualization system LitVizG gVid/i2gLogin software (and VTK version 4.4.2) Visualisation tools performance tests 8

  9. MJRA1.1Design phase closed(2) Design phase closed (MJRA1.1) – continued • Milestone reached on time(PM04) • Milestone summarized in two reports: • DJRA1.1“Performance analysis of sequential and parallel visualization in GRID environment” (PM03) • DJRA1.2“Design phase, interoperability and definition of cooperation with other activities: SA1, NA3, SA3 and plan for education trainings in co-operation with NA2” (PM04)

  10. MJRA1.2 First prototype ready(1) First prototype ready (MJRA 1.2) • Enhancement of BalticGrid-I NA3 project components to be compatible with Grid standards • Providing support for advanced data management • File manager (GridCommander) deployed as an independent network application • Restructuring of The Migrating Desktop • Mechanism for easy integration of various file systems • Changes in implementation of existing file systems • Support for Grid data access mechanisms • Gridcom groupware development • The first deployable release • Gridcom recovering after system restart • Administrative commands for system configuration • Error handling improvements • Security enhancements

  11. First prototype ready (MJRA 1.2) - continued Deployment of the software in BG-II testbed for visualization Visualization tools deployedconsidering outcome of performance analysis. All tools are based on VTK to minimize development efforts with gLite compatible architecture. ParaView 3.4.0– an open-source software suitable for parallel visualization and parallel rendering of large datasets. Visualization e-serviceVizLitGis designed for convenient access and visualization of remote data files located in grid. VTK 5.2.1 applicationsinteractively run on grid by means ofGVidsoftware. BG-II users can employ full power of huge toolkit functionality and flexible interactivity. Milestone reached on time(PM09) The first prototype details described in report: DJRA1.3 - “First prototype […]”(PM09) MJRA1.2 First prototype ready(2) 11

  12. Migrating Desktop Handling gLite parametric jobs Changes of job description structures Support for parametric jobs in submission mechanisms Job monitoring mechanisms - improvements Providing support for list of parameters MJRA 1.3 - Second prototype ready (1) 12

  13. Migrating Desktop MD - VizLitG integration VizLitG integrated as MD file viewer (HDF5) Definition and management of task flow Evaluation of existing tools Adoption of the Kepler workflow orchestration system Publishing Kepler for BalticGrid-II users Preparation of training materials Recorded demos Tutorials User guides MJRA 1.3 - Second prototype ready (2) 13

  14. MJRA 1.3 - Second prototype ready (3) Visualization Tools • Adaptation of e-Service VizLitGto BG-II user needs: • Enhanced interactivity including VTK widgets, • Improvedsecurity (Message Authentication over SSL). • Open-source package ParaView v3.6.1: • Developed unstructured HDF5 file reader for decomposed data files of pilot applications, • Distributed GPU rendering employed on grid. • Advanced functionality of VisPartDEM: • Parallel visualization of large particle systems, • Visualization of initial defects and propagating cracks, • Visualization of safety margin forces. 14

  15. Gridcom New: User Access Control Owner and many read-only users User management UI Handy for adminsand colleagues New: Documentation Brochure, article and movie New: Official Gridcom Web Site http://sig.balticgrid.org/gridcom MJRA 1.3 - Second prototype ready (4) Danila: Rewrite this page pls, to make it more descriptive. E.g. „User management UI” – creation? Enhancement? Design? 15

  16. Milestone reached on time(PM18) The secondprototype details described in raport: DJRA1.4 - “Second prototype […]”(PM18) MJRA 1.3 - Second prototype ready (5) 16

  17. MJRA 1.4 - Final version of services(1) MJRA1.4 Final version of services (PM24) Preparation of final release of components User support – publishing of user guides, tutorials Survey of services for user-level support of Grid data management Migrating Desktop Evaluation of Migrating Desktop Framework Optimization of developed mechanisms User support – publishing of user guides, tutorials Gridcom Documentation 17

  18. MJRA 1.5 - Final version of services(2) MJRA1.4 Final version of services (PM24) Assessment of performance and flexibility of visualization tools Open-source package ParaView: Analysis of special purpose OpenGL shaders, Performance tests (Done) Applications (Planned 3, Done 3) Grid Visualization e-Service VizLitG: Performance tests (Done) Applications (Planned 3, Done 3) Visualization toool VisPartDEM: Light version of tool and GUI, Performance tests, Applications (Planned 3, Done 2). Arnas: Update 18

  19. Summary of work done - usage All JRA tools are designed to be general Most components could be used with no integration Examples of current and planned usage: ParaView : Hopper discharge problem (Particle Technology, Engineering Modelling Tasks) /Integrated/, Dam break problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Integrated/, Oil filter problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Planned/. VizLitG: Tri-axial compaction problem (Particle Technology, Engineering Modelling Tasks) /Integrated/, Dam break problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Integrated/, Convective transport problem (Computational Fluid Dynamics, Engineering Modelling Tasks) /Planned/, VisPartDEM: Tri-axial compaction problem (Particle Technology, Engineering Modelling Tasks) /Integrated/, Hopper discharge problem (Particle Technology, Engineering Modelling Tasks) / Integrated /, Crack propagation problem (Particle Technology, Engineering Modelling Tasks) /Planned/. Gridcom MDS (Multidimensional scaling with city-block distances) HIROMB (operational hydrodynamic model for Lithuanian Baltic Sea coastal area) SHYFEM/AQUABC (Hydrodinamic-ecological model parameter sensitivity analysis)… /Integrated/ GAUSSIAN NWCHEM SBIO NEURO PAR VIBRO/Planned/ Migrating Desktop GAMESS, SYNTSPEC (stellar spectra modelling), SemTi-Kamols (natural language processing), CoPS (Complex Comparision of Protein Structures), ANSYS /Integrated/ GAUSSIAN, deMon, PADEEA /Planned/ Arnas, Danila – update your parts 19

  20. Presentations & Publications (1) EGEE’08 conference (Istanbul, Turkey) Live demo "Using the BalticGrid-II infrastructure:  SemtiKamols - a linguistic analyser of Latvian language„ EGEE UF’09 conference(Catania, Italy) Demo “CoPS - The Complex Comparison of Protein Structures supported by grid” Talk ‘The Migrating Desktop as a framework for grid applications” NDTCS-2009 (Vilnius, Lithuania): Presentation “Grid visualization e-service VizLitG” 1st International Conference on Parallel, Distributed and Grid Computing for Engineering, (Pécs, Hungary) Presentation “Computation and Visualization of Poly-Dispersed Particle Systems on gLite Grid” 20

  21. Presentations & Publications (2) XVIIth seminar of Lithuanian Association of Computational Mechanics, (Lithuania) Invited presentation “Scientific computations, graphical environments and visualization in grid environment“ BalticGrid-II Summer School (Moletai, Lithuania) Lecture “Enhanced Application Services on Sustainable eInfrastructure“ EU DORII Summer School (Linz, Austria) Tutorial “Migrating Desktop - intuitive graphical interface to Grid resources” EGEE’09 conference (Barcelona, Spain) Live demo - "Migrating Desktop - Intuitive Interface to Grid Resources" Live demo "Visualization e-services and tools for grid build by gLite" 21

  22. Presentations & Publications (3) Publications: R. Kačianauskas, A. Maknickas, A. Kačeniauskas, D. Markauskas, R. Balevičius. Parallel discrete element simulation of poly-dispersed granular material. Advances in Engineering Software, 41(1), 2010, 52–63. A. Kačeniauskas, R. Kačianauskas, A. Maknickas and D. Markauskas. Computation and Visualization of Poly-Dispersed Particle Systems on gLite Grid Civil-Comp Proceedings, vol. 90, ISSN 1759-3433, Proc. of 1st International Conference on Parallel, Distributed and Grid Computing for Engineering (Eds. B.H.V. Topping and P. Iványi), ISBN 978-1-905088-28-7, Civil-Comp Press, Stirlingshire, United Kingdom, 2009, p. 1-18. [ISI Proceedings] A Kačeniauskas, R. Pacevič, T. Katkevičius, A. Bugajev. Grid visualization e-service VizLitG. CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer Simulations (Eds. A. Melker, V. Nelayev, J. Tamuliene), Vilnius, Vol. 13, 2009, 92-98. A Kačeniauskas, R. Pacevič, T. Katkevičius. Dam break flow simulation on grid. CDROM Proc. of 13th International Workshop on New Approaches to High-Tech: Nano Design, Technology, Computer Simulations (Eds. A. Melker, V. Nelayev, J. Tamuliene), Vilnius, Vol. 13, 2009, 85-91. A. Kačeniauskas. Mass conservation issues of moving interface flows modelled by the interface capturing approach. Mechanika, ISSN 1392-1207, 2008, 69(1), p. 35-41. 22

  23. Presentations & Publications (4) Disseminative materials: JRA technical brochure: Enhanced Application Services on Sustainable e-Infrastructure Technical brochure: “Grid visualization tool VisPartDEM” Technical brochure: “Grid visualization e-service VizLitG” The poster: “Grid Visualization e-Service VizLitG” Technical brochure: “ParaView on BalticGrid-II” The poster: “ParaView on BalticGrid-II” Arnas: Paste here one/two brochures, pls Danila: Any diss materials? 23

  24. Beyond the BalticGrid-II • User support for JRA products • Further development: • Migrating Desktop – PL-Grid (NGI), Euforia (EU) • Gridcom - ( • visualization tools – LitGrid (NGI), …(?) Add plans of development/support of Gridcom, viz tools, pls

  25. Conclusions The works are proceeding smoothly as planned Good cooperationwithinactivity All planned activity objectives fullfilled The all milestones achieved on time The deliverables completed on time Prototypes delivered Services prepared and deployed Prototype evaluated by SA3 Effective cooperation with other project activities NA2 – support for educational and disseminative activities NA3, SA3 – support for the users No technical problems that affected objectives Plans 25

  26. Thank you for your attention! 26

More Related