1 / 18

SRB Data Grid and Compute Grid Integration via the EnginFrame Grid Portal

SRB Data Grid and Compute Grid Integration via the EnginFrame Grid Portal. Paolo Maggi <paolo.maggi@polito.it> < paolo.maggi@nice-italy.com>. SRB Workshop, February 2-3, 2006, San Diego. Data and Computational GRID integration.

thanh
Download Presentation

SRB Data Grid and Compute Grid Integration via the EnginFrame Grid Portal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SRB Data Grid and Compute Grid Integration via the EnginFrame Grid Portal Paolo Maggi <paolo.maggi@polito.it> < paolo.maggi@nice-italy.com> SRB Workshop, February 2-3, 2006, San Diego

  2. Data and Computational GRID integration • Goal: integration of heterogeneous computing systems and data resources with the aim of providing a global computing space Using the EnginFrame Grid portal to develop innovative services that integrate applications that: • Are computationally-intensive computational Grid • Need access to large amounts of geographically distributed data data Grid SRB Workshop, February 2-3, 2006, San Diego

  3. What is EnginFrame? • It is a web-based technology that enables the access and the exploitation of Grid-enabled applications and infrastructures • It allows organizations to provide application-oriented computing and data services to both users (via Web browsers) and applications (via SOAP/WSDL and/or RSS), hiding all the complexity of the underlying Grid infrastructure • It greatly simplifies the development of Web portals exposing computing services that can run on a broad range of different computational Grid systems • It seamlessly integrates with JSR168 compliant enterprise portals SRB Workshop, February 2-3, 2006, San Diego

  4. EnginFrame adoption • Industries • Mechanical: Ferrari, Audi, BMW, FIAT Auto, Delphi, Elasis, Magneti Marelli, P+Z, Swagelok, Toyota, TRW • Manufacturing: Bridgestone, Procter & Gamble, Galileo Avionica • Oil&Gas: Slavneft, Schlumberger, TOTAL, VNIIGaz • Electronics :STMicroelectronics, Accent, SensorDynamics, Motorola • Biotech: ENEA, EGEE LS community • Telecom: Telecom Italia • Research • CERN, INFN, ASSC, CCLRC, CILEA, CINECA, CNR, CNRS/IN2P3, ENEA, FzU, ICI, IFAE, ITEP, JSC G.G.M., KU Leuven, SSC-Russia, • EnginFrame is the technology on which is based GENIUS, the official Grid portal of the European project EGEE SRB Workshop, February 2-3, 2006, San Diego

  5. Grid Portal execution flow User Spoolers HTML page Service Req XML output Service Req Browser HTML Layout SDF Custom plugin Groups, ACLs XSL XML XML Script + XML Admin Application Server EnginFrame Server EnginFrame Agent Grid XSLT Execute Authorize SRB Workshop, February 2-3, 2006, San Diego

  6. Grid Gateway execution flow User Spoolers Results Service Req XML output Service Req SDF Custom plugin Groups, ACLs XML XML Script + XML Admin Application Server EnginFrame Server EnginFrame Agent Grid Authorize Execute SRB Workshop, February 2-3, 2006, San Diego

  7. EnginFrame-SRB integration Possible solutions: • simple plug-in that interacts with SRB through the S-commands • light integration • it quickly provides valuable results for a first prototype implementation • extension to the EnginFrame spooler concept in order to seamlessly and directly embrace SRB collections • more robust approach • it implies more development efforts to write new Java modules to be plugged into the EnginFrame core architecture SRB Workshop, February 2-3, 2006, San Diego

  8. SRB plug-in features Implemented features: • SRB enabled Remote File Browsing (RFB) • SRB enabled Virtual Spooler • Metadata support • Data transfer SRB Workshop, February 2-3, 2006, San Diego

  9. SRB enabled Remote File Browsing (RFB) • Extension of the standard RFB feature to allow SRB users to browse collections in SRB space and select files from within a standard Web browser SRB Workshop, February 2-3, 2006, San Diego

  10. XML representation of a SRB Collection <ef:rfb xmlns:ef="http://www.enginframe.com/2000/EnginFrame"> <spooler path="/NiceZONE/home/srbadmin.nice-italy.com/FDS"> <file name="FDSDemo.data" size="4407" timestamp="2006-01-31-15.55" /> <file name="sample.txt" size="5" timestamp="2005-09-19-16.09" /> <directory alias="Results" name="Results" /> <directory alias="SampleInputData" name="SampleInputData" /> </spooler> </ef:rfb> SRB Workshop, February 2-3, 2006, San Diego

  11. SRB enabled Virtual Spooler • Extension of the standard EnginFrame Spooler to seamlessly show files and collections stored in an SRB virtual file system SRB Workshop, February 2-3, 2006, San Diego

  12. Metadata support • Both the SRB RFB and Virtual Spooler features support the view-queries of metadata associated to SRB data SRB Workshop, February 2-3, 2006, San Diego

  13. Data transfer • The plug-inallows to send-retrieve files to-from SRB and to-from EnginFrame portal SRB Workshop, February 2-3, 2006, San Diego

  14. Script implementing streaming download # Usage: ef.download <file_to_download> #------------------------------------------------------ # Init environment … SRB_PATH="`$CAT "$EF_SPOOLER"/.srb`" SRB_SUBPATH="$FILE" SRB_FULLPATH="${SRB_PATH}/${SRB_SUBPATH}" Sinit >/dev/null 2>&1 Scat "${SRB_FULLPATH}" 2> /dev/null Sexit >/dev/null 2>&1 SRB Workshop, February 2-3, 2006, San Diego

  15. Demonstrative services • FDS (Fire Dynamics Simulator) demonstrative service: • demonstrates how EnginFrame together with our SRB plug-in can be used to enable the execution of legacy applications in data and computational Grid environments • SPM (Statistical Parametric Mapping) application: • consists in the “Webification” of an innovative data Grid enabled application for the early diagnosis of Alzheimer’s disease (AD) through the quantitative comparison of PET images stored in SRB SRB Workshop, February 2-3, 2006, San Diego

  16. SPM demonstrative service SRB Workshop, February 2-3, 2006, San Diego

  17. Conclusions • We have proposed a method to integrate SRB data Grid and compute Grid components via the EnginFrame Grid portal • Two different demonstrative services have been described to show how it is possible to exploit this type of integration • The SRB plug-in is still a prototype • We expect SRB plug-in will be useful in the construction of general data exchange infrastructures for wide range of different application areas SRB Workshop, February 2-3, 2006, San Diego

  18. Thanks for your attention! Nice SRB Workshop, February 2-3, 2006, San Diego

More Related