1 / 22

EDGeS infrastructure for the EGEE user community

EDGeS infrastructure for the EGEE user community. Peter Kacsuk kacsuk@sztaki.hu MTA SZTAKI. What is EDGeS?. EDGeS: Enabling Desktop Grids for e-Science EDGeS was a 2-year FP7 project completed on the 31 st of March 2010

pelham
Download Presentation

EDGeS infrastructure for the EGEE user community

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EDGeS infrastructure for the EGEE user community Peter Kacsuk kacsuk@sztaki.hu MTA SZTAKI The EDGeS project receives Community research funding

  2. What is EDGeS? EDGeS: Enabling Desktop Grids for e-Science • EDGeS was a 2-year FP7 project completed on the 31st of March 2010 • Its primary goal was to support EGEE user communities in running their applications on massive volunteer desktop grid (DG) systems • To achieve this EDGeS • created an infrastructure to extend EGEE VOs with DG systems • provided an application porting and validation service

  3. Jobs EDGeS portal EDGeS bridge services EDGeS Appl Repository WUs 3G Bridge 3G Bridge 3G Bridge EDGeS@home (5.000 CPUs) Extremadura School DG (15.000 CPUs) The EDGeS infrastructure EGEE VO1 EGEE VO2 EGEE VOn DG1 DG2 DGn

  4. BOINC DC-API Plugin Job source EGEE GRAM EGEE Our Grid OurGrid Plugin XtremWeb gUSE/ WS-PGRADE portal XtremWeb Plugin Job source gUSE submitter Generic Grid-Grid (3G) Bridge to extend SGs with DGs 3G Bridge Job Database Queue Manager GridHandler Interface Job Handler Interface

  5. Get Output Submit job Check status 3G Bridge as a WS 3G Bridge Job DB Grid Plugin1 HTTPD Grid Plugin2 Grid Handler Interface Queue Manager Grid Plugin3 WSSubmitter Download Manager Grid Pluginn Fetch input files

  6. EGEE VO  DG system DG servers EDGeS Services BOINC1 (SZDG) WS interface 3G Bridge DC-API plugin EGEE BDII (with DG-CE) DG-CE Info provider DG-LRMS QM WS client BOINC2 (UoW) EGEE WMS WS interface 3G Bridge DC-API plugin Send job EGEE LB EGEE VOMS Check EXE Submit job Watch Get output XWeb IN2P3 3G Bridge XWeb plugin WS interface X509 proxy EGEE UI EDGeS Application Repository

  7. EGEE VO  DG system DG servers EDGeS Services BOINC1 (SZDG) WS interface 3G Bridge DC-API plugin EGEE BDII (with DG-CE) DG-CE Info provider Report resources and performance DG-LRMS QM WS client BOINC2 (UoW) EGEE WMS WS interface Submit job 3G Bridge DC-API plugin Send job Log events Send output EGEE LB EGEE VOMS Check EXE Submit job Watch Get output XWeb IN2P3 3G Bridge XWeb plugin WS interface X509 proxy EGEE UI EDGeS Application Repository Get EXE

  8. EDGeS Appl. Repository Service Grid EGEE LocalDG GlobalDG EGEE User access to various grids University DG e.g. Univ. of Westminster Volunteer DG e.g. EDGeS@home

  9. EDGeS@home

  10. EGEE VO extension with a single DG EDGeS VO BOINC1 server EDGeS CE machine QM DB WMS Machine Other EGEE services WS Interface DC-API plugin QM WS client LCG-CE UI machine WN WN WN WN WN WN

  11. EGEE VO extension with a single DG EDGeS VO BOINC1 server EDGeS CE machine QM DB WMS Machine Other EGEE services WS Interface DC-API plugin QM WS client LCG-CE UI machine WN WN WN WN WN WN

  12. EGEE VO extension with two DGs EDGeS VO BOINC1 server EDGeS CE machine QM DB QM WS client WMS Machine Other EGEE services WS Interface DC-API plugin QM WS client BOINC2 server QM DB WS Interface DC-API plugin LCG-CE UI machine WN WN WN WN WN WN

  13. Portal -> SEEGRID ->DG and portal->VOCE infrastructure DG server machine EDGeS Bridge Services CE Core 3G Bridge DG Server SEEGRID WMS CE+ Bridge Client WS Interface AR Cache EDGeS portal AR Desktop 1 Desktop 2 Desktop N VOCE WMS VOCE CE

  14. MoUs with other projects • Signed MoU with EGEE III • Jointly select EGEE applications that should be migrated to EDGeS • Collaboration in porting these appls to EDGeS • EGEE support for the establishment and operation of the EDGeS VO • Organizing joint events (summer school, user forum meetings) • Signed MoU with • EELA-2 • IberCivis DG • SEE-GRID-SCI Introduction Author: Ad Emmen RI-211727 NA3 version: 1.0 15

  15. Ported Applications

  16. Ported Applications

  17. Using the EDGeS infrastructure outside the EU • New FP7 project: DEGISCO • Objectives: to support non-EU countries to create their national EDGeS infrastructure: • Brazil • China • Kazakhstan • Russia • Taiwan • Ukraina • Representatives of other national grids are welcome to join DEGISCO

  18. EDGI scope for both compute and data intensive apps for EMI/EGI (gLite, ARC, Unicore) EDGeS scope only for compute intensive apps for EGEE (glite) Extension of the EDGeS infrastructure: EDGI

  19. Academic grid/cloud ecosystem Supercomputer based SGs (DEISA, TeraGrid) OGF PGI Cluster based service grids (SGs) (EGEE, OSG, etc.) EDGeS/EDGI Desktop grids (DGs) (volunteer DGs – home computers, organizational DGs – institutional desktops) EDGI Academic Cloud

  20. Summary • EDGeS enables to extend gLite VOs with • BOINC or XtremWeb public or local DGs • Current DGs: • EDGeS is an open infrastructure: • Any gLite based VO can be extended with DGs • EDGI helps in EU countries and DEGISCO in non-EU countries to extend gLite based VOs with DGs • Anyone can support EGEE applications by donating desktop cycles to EDGeS@home • Any EGEE user can access EDGeS: • EDGI and DEGISCO helps any EGEE user community in porting their applications into EDGeS • EDGeS Application Repository stores applications already ported to EDGeS and usable by any EDGeS users

  21. Any questions? Thank you for your attention … For more information please visit the EDGeS Website: Join the EDGeS User & Industry Forum here! http://www.edges-grid.eu/ Please contact us if you need support in porting your application to EDGeS Email:kacsuk@sztaki.hu

More Related