1 / 1

Multi-platform Automated Software Building and Packaging

Multi-platform Automated Software Building and Packaging. Andres ABAD RODRIGUEZ (IT-GT / CERN) V.E . GOMES GOUVEIA (IT-GT/CERN), D. MENESES ( IT-GT/CERN ), F . CAPANNINI ( INFN), A. AIMAR ( IT-GT/CERN), A. DI MEGLIO (IT-DI/CERN).

benita
Download Presentation

Multi-platform Automated Software Building and Packaging

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Multi-platform Automated Software Building and Packaging • Andres ABAD RODRIGUEZ (IT-GT / CERN) • V.E. GOMES GOUVEIA (IT-GT/CERN), D. MENESES (IT-GT/CERN), F. CAPANNINI (INFN), A. AIMAR (IT-GT/CERN), A. DI MEGLIO(IT-DI/CERN) The EMI (European Middleware Initiative) project is the integration of the main European pre-existing middlewares (gLite, UNICORE, ARC and dCache) into a single consistent set of packages with uniform distribution and repositories. The products that became part of EMI were built using different tools and dedicated services. The software, millions of lines of code, is written in several programming languages and platforms. Despite this heterogeneous initial situation, a single common solutionwas needed for building, testing, packaging and QA. The ETICS service, already used by the gLite components, was selected for the EMI project. Products & Languages v ARC Clients WMS CANL WNoDeS AMGA MPI Argus BDII FTS EMI Messaging CREAM CE VOMS EMIR YAIM APEL ARC Infosys dCache gLite Security LFC LCAS ARC CE Logging and Bookkeeping glExec Infosys SAGA StoRM UNICORE security DPM UNICORE Container ETICS allows the specification of the check out, build and test commands, dependencies specification and environment definition of the whole software stack. The ETICS jobs are run on demand created Virtual Worker Node. The platforms supported in EMI are Scientific Linux 5 and 6 (32 and 64 bits) and Debian 6 (64 bits). This solution reduces the number of physical machines to the minimum (only for the main servers). Multiple metrics can be collected during the build execution. There are many out of the box metrics plugins for static source code analysis such as Findbugs, pUnit, etc. The system can be easily extended to support other QA tools. The reports and artifacts are stored in the repository and the worker node is reused. Other interesting features are multi node testing and the repository graphical interface from where the artifacts can be easily accessed and browsed. EMI build, test and packaging infrastructure Build/Test Artifacts Repository Web Service Report/Metrics DB Configuration Configuration DB Web Service Scientific Linux Condor Execution Engine Virtual Worker Nodes EMI repository • ETICS also builds software using standard tools such as Mock and Pbuilder. The artifacts produced by the system are compliant with the EPEL and Debian guidelines. The compliance level is automatically monitored running the RPMLint and Lintian plugins. • The packages created, reports and metrics generated are stored in the EMI repository. These packages are ready to be included in the Debian, FedoraEPEL and EGI UMD repositories. Source and RPM packages DEB packages Reports & metrics Binary TAR.GZ EPEL Repository EGI UMD Repository Squeeze Repository For more information: http://cern.ch/emi-tools-chep2012

More Related