1 / 21

Introduction to EDGI

Introduction to EDGI. Peter Kacsuk, MTA SZTAKI kacsuk@sztaki.hu http://edgi-project.eu Start date: 2010-06-01 Duration: 27 months. EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556. EU FP7 projects on desktop grids EDGeS –> EDGI and DEGISCO.

urania
Download Presentation

Introduction to EDGI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Introduction to EDGI Peter Kacsuk, MTA SZTAKIkacsuk@sztaki.hu http://edgi-project.eu Start date: 2010-06-01 Duration: 27 months EDGI is supported by the FP7 Capacities Programme under contract nr RI-261556

  2. EU FP7 projects on desktop grids EDGeS–> EDGI and DEGISCO furtherdeveloped by supported by • DEGISCO • Disseminate EDGeS results world-wide • Green IT aspects • EDGI • ARC, Unicore, Clouds • QoS with Clouds • Data intensive apps • SG->DG direction support • EDGeS • DG<->SG integration: • gLite → BOINC, XtremWeb • BOINC, XtremWeb → gLite • Compute intensive applications 2008 - 2010 2010 - 2012

  3. EDGeS and EDGI EDGI scope for both compute and data intensive applications for EMI/EGI (gLite, ARC, Unicore) Extend Desktop Grids with Clouds for QoS • EDGeS scope only • for compute intensive applications • for gLite

  4. Basic EDGI architecture Unicore grid Unicore MCE submit ARC MCE ARC grid AR attic monitor submit 3GBridge DGPro-ject down-load UserIF BridgeIF AR Volunteer/InstitutionalResources monitor DG client gLite grid CREAM MCE CREAM MCE submit Monitor AR AR attic attic monitor monitor UI inspect

  5. Advanced EDGI architecture Unicore grid Unicore MCE submit upload ARC MCE ARC grid Eucalyptus/Amazon AR attic monitor Attic FS UI DG client submit attic 3GBridge down-load UserIF BridgeIF AR cloud attic DGPro-ject Volunteer/InstitutionalResources monitor DG client attic gLite grid CREAM MCE CREAM MCE submit Monitor AR AR attic attic monitor monitor UI inspect

  6. MetaJob concept to increase performance ARC MCE upload AR attic monitor ARC grid Eucalyptus/Amazon Attic FS UI DG client Single job submit attic MetaJob as a single job Unfolding UserIF BridgeIF AR 3GBridge down-load cloud Huge number of jobs attic DGPro-ject Single job Volunteer/InstitutionalResources monitor DG client CREAM MCE attic gLite grid AR attic monitor submit Monitor UI inspect

  7. EDGeS@home

  8. EDGeS@home

  9. Institutional DGs: University of Westminster Local DG 6 1 2 5 4 3 • New Cavendish Street 576 nodes • Marylebone Campus 559 nodes • Regent Street 395 nodes • Wells Street 31 nodes • Little Tichfield Street 66 nodes • Harrow Campus 254 nodes • Total: 1881 nodes • Lifecycle of a node: • PCs basically used by students/staff • If unused, switch to Desktop Grid mode • No more work from DG server -> shutdown (green solution)

  10. Typical EDGI infrastructure configuration EDGI AR BOINC Client Public or Local DG BOINC Server gLite UI 3G Bridge WMS MCE BOINC Client CE EDGI portal CC CC

  11. Typical EDGI infrastructure configuration EDGI AR BOINC Client Public or Local DG BOINC Server gLite UI 3G Bridge WMS MCE BOINC Client CE EDGI portal CC CC

  12. Typical EDGI infrastructure configuration BOINC Client Public or Local DG BOINC Server 3G Bridge BOINC Client EDGI portal CC CC

  13. Usage scenarios of EDGI technology for EGI/NGI VOs Extending VOs by using the EDGI services SG VOs can be extended by existing EDGI DG resources SG VOs can be extended by new institutional DGs First create institutional DG system (e.g. Univ. of Westminster local DG) SG VOs can be extended by new volunteer DGs SG VOs can be extended by all of the above Building infrastructure by installing the EDGI services: extending the VO with: A modified CE (Application Repository if virtualization is not used) Using the infrastructure SG users can submit applications by their CLI SG users can submit applications via the EDGI portal

  14. Parameter study application execution in desktop grids GEN Generates input parameter space SEQ SEQ SEQ SEQ Parameter sweep jobs: To be executed in DGs • Two options: • registered/ported appl • Any appl COLL Evaluates the results of the simulation

  15. The typical option in the past for BOINC • Port the application to BOINC • Create master code (BOINC API, DC-API) • Create client code (BOINC API, DC-API, BOINC Wrapper, GenWrapper) • Register the application on the BOINC server • Run the application

  16. The new option for BOINC • Register the GBAC (Generic BOINC Application Client) application on the BOINC server • Run any application as input parameter of the GBAC application • Generate as many GBAC workunits for BOINC as many parametric jobs are in your application.

  17. Demo configuration BOINC Client (VirtualBox) SZTAKI Cloud WS-PGRADE 3G Bridge (GBAC) BOINC Server (GBAC) BOINC Client (VirtualBox)

  18. IDGF (International Desktop Grid Federation)

  19. IDGF (International Desktop Grid Federation)

  20. IDGF (International Desktop Grid Federation) New project: IDGF-SP Starting in September 2012

  21. Conclusions • Without any effort your VO can be connected to the EDGI infrastructure and the users of your VO can get access to 10.000-100.000 machines for BoT/PS applications • Please, try the EDGI infrastructure and contact us: Peter Kacsuk (kacsuk@sztaki.hu) (coordinator of EDGI, EDGeS) JozsefKovacs (jozsef.kovacs@sztaki.hu) (technical coordinator) Websites: www.edgi-project.eu http://desktopgridfederation.org/

More Related