1 / 23

EMI 1 and WLCG

EMI 1 and WLCG. Francesco Giacomini (INFN) - SA1 Morris Riedel (JSC) – JRA1. Outline. EMI 1 Release Plan Francesco Giacomini (INFN) EMI 1 Developments Morris Riedel (JSC). Release Plan. Start. EMI 1. EMI 2. EMI 3. Major releases. Supp. & Maint . Support & Maintenance.

marlin
Download Presentation

EMI 1 and WLCG

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EMI 1 and WLCG Francesco Giacomini (INFN) - SA1 Morris Riedel (JSC) – JRA1

  2. Outline • EMI 1 Release Plan • Francesco Giacomini (INFN) • EMI 1 Developments • Morris Riedel (JSC) WLCG GDB, CERN

  3. Release Plan Start EMI 1 EMI 2 EMI 3 Major releases Supp. & Maint. Support & Maintenance Support & Maintenance Support & Maintenance 01/05/2010 30/04/2011 30/04/2012 28/02/2013 WLCG GDB, CERN

  4. Stability vs Innovation • Periodic major releases of the distribution • Tentatively once per year • Right place to introduce new features and backwards-incompatible changes • Minimize number of changes within a major release • Clear separation between maintaining what is in production and introducing new features • SA1 vs JRA1 • People (developers, testers, etc.) are the same, but the rules are different in the two contexts WLCG GDB, CERN

  5. Release Plan Start EMI 1 EMI 2 EMI 3 Major releases Supp. & Maint. Support & Maintenance Support & Maintenance Support & Maintenance 01/05/2010 30/04/2011 30/04/2012 28/02/2013 WLCG GDB, CERN

  6. Support • Two EMI major releases supported at any time • Lifetime of an EMI major release is two years • Full support: 18 months • Security only: another 6 months • Applies to previous mw distributions as well • e.g. gLite 3.2 and arc 0.8.x would be fully supported until October 2011, with security updates until April 2012 WLCG GDB, CERN

  7. Deployment Highlights • Guiding principles: simplification and adoption of established best practices • EMI 1 reference platform: SL5/64 + EPEL • SL6 and Debian available in EMI 2, maybe sooner already during EMI 1 for some components • One EMI repository (per major release) for all services • base + updates + security • Following EPEL packaging policies • e.g. installation in /usr, not in /opt/glite • Full compliance may be achieved later • Metapackages just for installation • Cannot be used to version the installation of a certain product • In general, no upgrade path between major releases • Including from gLite 3.2 to EMI 1 WLCG GDB, CERN

  8. EMI 1 Developments At a Glance WLCG GDB, CERN

  9. EMI 1 Developments At a Glance • Development impacts: Integrated Release • EPEL-compliantcomponentinstallation (/usr) • Change of Globus from VDT to EPEL(IGE project officiallysupports the EPEL version) • Key Developments • VOMS usingstandard SSL (insteadof GSI) • Startedmigrationtowards GLUE2 • Improvedinformationvalidationcheckings • Improvements for Data components • NFS4.1, WebDAV, betterperformance, etc. WLCG GDB, CERN

  10. EMI 1 Developments – Security WLCG GDB, CERN

  11. EMI 1 Developments – gLite Security • VOMS • Drop of the dependencies on Globus Toolkit • Will simplify the installation (+ smallersize) • Completedintegrationof VOMRS functionalities in VOMS-Admin • (VOMRS itselfisgoingto end support) • Usabilityimprovements: Bettererrormessages, cleaner handlingof invalid inputs • REST interfacetoobtain VOMS ACs • Nomajorfeatures in securitycomponents WLCG GDB, CERN

  12. EMI 1 Developments – Compute WLCG GDB, CERN

  13. EMI 1 Developments – CREAM • CREAM-CE (CREAM, BLAH, CEMON) • Experimental GLUE 2 support • Working on solutionswithinformationproviders • GLUE1.3 still supported • ARGUS Integration for both CREAM andCEMon • Config: Using ARGUS orexistingauthZwithgJAF • Bettersupport for multicoreallocations • (i.e. JDL attributesWholeNodes, HostNumber, etc.) WLCG GDB, CERN

  14. EMI 1 Developments – WMS • Workload Management System (WMS) • Work in progress: Adoption of GLUE2, but in WMS needstobefurtherinvestigated • Manage GLUE1.3 and GLUE2 in JDL unclear • Support for 'feedback‘ • Jobs 'stuck' in a queue for toolongcanbemigrated on another Computing Element • Atconfiguration time: feature must beenabledtoworkasdescribed WLCG GDB, CERN

  15. EMI 1 Developments – ARC CE • EMI 1 A-REX based ARC CE • End oflifeofGrid Manager • The same interfacesarekept • In addition: New Web serviceinterface • Existingfeatureskept • New Features: plugins, improvedinput/outputdatahandling, GLUE2 informationpublishing, newsecurityframework • ARGUS support (experimental) • http://www.nordugrid.org/arc/gm-eol.html WLCG GDB, CERN

  16. EMI 1 Developments – Data WLCG GDB, CERN

  17. EMI 1 Developments – dCache • dCache • Initial GLUE2 support for exposingstorageinformationin parallel to GLUE1.3 • NFS4.1 Support (clientcomesfreemostlikely in SL6) • WebDAV Support • Support for ARGUS blacklisting • Significantlyimprovedconfigurationsystem • Alreadytestedatselected Tier 1's and Tier 2's. • More details, tutorialsandhands-on will beprovidedduring the "5. dCache Workshop" in Goettingen (16/17 March) • http://indico.desy.de/conferenceDisplay.py?confId=3959 WLCG GDB, CERN

  18. EMI 1 Developments – FTS & DPM • File Transfer Service (FTS) • Support for resuminggridftptransferswhere the endpointsallowit • Disk Pool Manager (DPM) • GLUE2 Support exposingstorageinformation(gfal/lcg_utilsupportexpectedshortly after EMI 1) • Improvedperformance in dpm-drain(parallel filereplication) WLCG GDB, CERN

  19. EMI 1 Developments – Infrastructure WLCG GDB, CERN

  20. EMI 1 Developments – Information • Nomajornewfeatures in BDII • Information flowlargelybased on GLUE1.3 movingtowards GLUE2 • But Information contentimprovement • Low confidencelevelthat the values for someattributesarecorrect • Betterinformationprovidersareneeded in the overallsetof relevant components • Bettertesttoolsavailablethatwework on • GLUE2 validation, GStattests WLCG GDB, CERN

  21. EMI 2 Outlook WLCG GDB, CERN

  22. EMI 2 Outlook • Solution for storage elements and catalogue synchronization • Common Storage Accounting Records • Input tostandardizationactivities • Common EMI Execution Service Interface • Preservebackwards-compatibility • Common Security Profiles • SAML&XACML: Common Attribute Profiles • Experimental adoptionofmessaging WLCG GDB, CERN

  23. Thank you EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611 WLCG GDB, CERN

More Related