1 / 16

Supporting EGI User Communities with Desktop Grid Resources

This article discusses the EDGI Application Support Service, its objectives, and activities in facilitating the migration and running of applications on the EDGI infrastructure. It also explores the benefits and types of applications suitable for the EDGI infrastructure, as well as tools and repositories available for application development and execution.

jcollins
Download Presentation

Supporting EGI User Communities with Desktop Grid Resources

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Supporting EGI User Communities with Desktop Grid ResourcesEGI Technical Forum, Lyon, 23.09.2011 Tamas Kiss- University of Westminster Leader of EDGI Application Support Service kisst@wmin.ac.uk EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556

  2. The EDGI Application Support Service • Aims and objectives: • facilitate the porting of applications to the EDGI infrastructure by primarily targeting EGI user communities • Activities: • Identify EGI user communities that require the power of the EDGI infrastructure • provide a service in order to aid the migration to and running of applications on the EDGI infrastructure Author: Tamas Kiss

  3. What can EGI users gain from utilising the EDGI infrastructure? • Large additional computing power can be utilized • Desktop Grids are easy-to-scale systems and able to collect 1-2 orders of magnitude more compute power than Service Grids • By interconnecting EGI and DG resources users can transparently execute applications on any arbitrary platform involved in the new infrastructure • As a consequence we get: • reduced turnover time • improved fault-tolerance (redundant computing) • higher throughput Author: Tamas Kiss

  4. What type of applications are suitable for the EDGI infrastructure? • Applications should run on both EGI and DGs • EGI supports a wider scale of applications than DGs • We should assure that the application runs on DGs • Requirements towards an application to be executable on DGs: • Parallelization: • Only master/worker or parameter sweep parallelisation • No MPI or internal communication between worker nodes • Nodes can only use the results of other nodes through the server • Data handling: • small or medium-sized (max. 100 MB per worker) inputs and outputs (especially for public DGs, could be larger in local DGs) • No shared data storage (in public DGs) • No confidential data (sent down to potentially un-trusted worker in public DG) Author: Tamas Kiss

  5. EADM – IDGF Application Development Methodology 2. Requirements analysis 3. Systems design 7. Validation 4. Detailed design 5. Implementation 6. Testing 8. Deployment 9. User support, maintenance & feedback 1. Analysis of current application

  6. Tools supporting application development and execution on SG/DG platforms • API level support –for the developer • DC-API: • Provides a uniform interface for different Grid systems (BOINC, Condor, XtremWeb) • GenWrapper: • Generic wrapper to port legacy applications to a BOINC platform without “Boincification” • High level graphical user interface –for the developer and the user • WS-PGRADE portal: • to support the transparent exploitation of SG/DG systems at workflow level • EDGI Application Repository: • Publish, select, download, and execute validated applications Author: Tamas Kiss

  7. The EDGI Application Repository Author: Tamas Kiss

  8. The EDGI Application Repositoryhttp://dev17-portal.cpc.wmin.ac.uk:8080/repository/ • AR stores: • metadata about applications and their various implementations (e.g. g-Lite, BOINC, XtremWeb) • input/output parameters and files • supporting VOs and DGs • executables of different implementations • Applications are validated to assure safe and correct execution • Data in the repository utilised by • end-users to find executables and metadata • SG to DG bridge when sending EGI applications to DG resources • 28 applications are currently in the AR ported by EDGeS, EDGI, and DEGISCO Author: Tamas Kiss

  9. The EDGI Application Repository Author: Tamas Kiss

  10. EDGI applications in EGI Application Database

  11. Application case-study Environmental Risks of Veterinary Medicines – user access via WS-PGRADE portal • Establish whether currently available bioinformatics databases are a potential tool to predict the effects of pharmaceutical compounds on aquatic organisms

  12. VisIVO - Visualisation Interface to the Virtual Observatory • a suite of software tools for creating customized views of 3D renderings from astrophysical data tables • User community: INAF Catania (Osservatorio Astrofisico di Catania) + University of Porthmouth • Grid enabled version: • For g-Lite based grids • Runs on the Cometa Consortium Grid – Catania, Messina, Palermo • Ported to the EDGeS platform to utilize Desktop Grid resources • Subcontractor in EDGI to further develop ported application Author: Tamas Kiss

  13. ViSAGE - Video Stream Analysis in a Grid EnvironmentCorrelation Systems Ltd. - Israel Visage processes Image pairs over the BOINC/EDGeS grid and paints movement in yellow. Video options: forward, backward, pause, play.. Insert video source: Insert Url of Server: Set mode to EDGeS Author: Tamas Kiss

  14. Application case-studyAutoDockVina via remotely accessible command line interface Bash script for submitting batch dockings (1 receptor – thousands of ligands) Submits remotely, uses the ws_master functions The ws_master submits work to a remote DG using web services. Takes care of file transfer, cleanup, download the outputs automatically. Over ½ million docking jobs completed on UoW local DG last month

  15. EMMIL – E-Marketplace Model Integrated with Logistics • three sided negotiation between buyers, sellers and third party logistics providers • Aims to optimise the total coast • Ported to EGEE as a parameter sweep application in the SEE Grid project • Large matrix solving – matrix can be separated and solution parallelised • Ported to EDGeS using GenWrapper Author: Tamas Kiss

  16. Thank you for your attention … Any questions? Please contact us if you need support in porting your application! Email:kisst@wmin.ac.uk • Join the International Desktop Grid Federation: • http://desktopgridfederation.eu 16 Author: Tamas Kiss

More Related