160 likes | 266 Views
WP6: Infrastructure & Application-oriented Services for User Communities Work Plan and Roadmap. Francisco Brasileiro Universidade Federal de Campina Grande – UFCG (Brazil) Vanessa Hamar Centre de Physique des Particules de Marseille – CNRS/CPPM (France)
E N D
WP6: Infrastructure & Application-oriented Services for User CommunitiesWork Plan and Roadmap Francisco Brasileiro Universidade Federal de Campina Grande – UFCG (Brazil) Vanessa Hamar Centre de Physique des Particules de Marseille – CNRS/CPPM (France) Kick-off Meeting, 21st – 24th September, 2010 San Luis Potosí (Mexico)
Outline • Goals • Success Metrics • Team • Modus Operandi • Management • Development • Support • Service Portfolio • Internal Milestones for 1st Year KoM – 23/09/2010 – San Luis de Potosí, Mexico
WP’s Goals as Described in the DoW The objective of … [WP6] is to enhance the grid experience of both users and system administrators by providing them with a portfolio of application-related and infrastructure-related Grid Services and the appropriate support to allow them to use these services adequately. The portfolio of services is mainly formed by the services developed in the context of the EELA-2 project and new services to be developed in the context of GISELA. KoM – 23/09/2010 – San Luis de Potosí, Mexico
Success Metrics • As stated in the DoW KoM – 23/09/2010 – San Luis Potosí, Mexico
Success Metrics • As should always be in the minds of WP6 team • Provide the services that will facilitate as much as possible • The growth, management and monitoring of thee-infrastructure • The porting and execution of applications KoM – 23/09/2010 – San Luis Potosí, Mexico
WP’s Team • UFCG (28 PM) • Francisco Brasileiro (WP manager), Nazareno Andrade, Guilherme Santos, Tarciso Oliveira, Rodolfo Viana • CPPM/CNRS (26 PM) • Vanessa Hamar (WP deputy manager),Andrei Tsaregorodtsev • UNIANDES (20 PM) • Harold Castro, Mario Villamizar, Germán Sotelo, Claudia Jiménez • INFN (6 PM) • Diego Scardaci KoM – 23/09/2010 – San Luis de Potosí, Mexico
WP’s Management Modus Operandi • One management meeting per month (normally via skype) with one representative from each institution involved • First one took place yesterday • Summary of activities sent by institution representative to management by e-mail every fortnight • Technical meetings will be schedule as required with the people concerned KoM – 23/09/2010 – San Luis de Potosí, Mexico
WP’s Development Modus Operandi • Development • Common tracking tool • Redmine • Issues • Task management • Distributed repositories • EELA-2 services (maintained by INFN) • OurGrid middleware (maintained by UFCG) • DIRAC (maintained by CERN) • Customized virtual clusters (maintained by UFCG) KoM – 23/09/2010 – San Luis de Potosí, Mexico
WP’s Support Modus Operandi (1/2) • Support tools • Project web page and service specific web pages • FAQ • Service description, manual and documentation • Mailing lists • Support for application-oriented services • Support for infrastructure-oriented services • Existing lists for more established services (eg. OurGrid, DIRAC) • Online assistance • Mainly for speeding up service deployment KoM – 23/09/2010 – San Luis de Potosí, Mexico
WP’s Support Modus Operandi (1/2) • Work in close cooperation with WP3 and WP4 • Define priorities and common actions • Help in training activities • Share tools • Ticket system for reporting issues with production software • Mailing lists for announcing new services • WP3 help to WP6 • Prospect VRCs to identify the need for new services • Validate new services • WP4 help to WP6 • Collaborate in the installation and test of new services developed KoM – 23/09/2010 – San Luis de Potosí, Mexico
Service Portfolio (1/3) • Application-related Services • Data Management • Digital archives • Secure storage • Cooperative annotation of data • Job management • DIRAC (better match making and customised scheduling) • OurGrid (scheduling of bag-of-tasks jobs) • Workflow for OurGrid jobs • WatchDog (monitoring and control of job execution on the gLite Worker Node) • Catalogue and file management • lcg-rec toolkit (recursive version of the lgc-* suite of commands) KoM – 23/09/2010 – San Luis de Potosí, Mexico
Service Portfolio (2/3) • Infrastructure-related Services • Support for resource centre deployment • OurGrid middleware • Interoperation gateways • gLite over Microsoft Windows platforms • VO compliant virtual machine environments • DIRAC • Support for grid operation • SAGE (Storage Accounting for Grid Environments) • Dashboard (Monitoring) KoM – 23/09/2010 – San Luis de Potosí, Mexico
Service Portfolio (3/3) • The portfolio is completed with services that are being developed in the context of GISELA • New services already identified • Aggregation of spare disk space in multiple desktops in a single Storage Element (UFCG and UNIANDES) • Efficient execution of data-intensive applications based on the MapReduce paradigm (UFCG) • Seamless execution of applications in hybride-Infrastructures augmented with the capability of interfacing with cloud computing providers (UFCG) • Customized virtual clusters (UNIANDES) • Others services under evaluation • MAGOS (UNIANDES) • Montera (CIEMAT) KoM – 23/09/2010 – San Luis de Potosí, Mexico
Milestones for the 1st Year (1/2) • By end of October, 2010 (M2) • Complete the setup of the development and support tools (redmine, wiki, mailing lists, etc.) • By November, 2010 (M3) • Deploy replicated DIRAC servers installed at UFRJ, CPPM and UFCG • Establish procedures to feed WP4 with monitoring and accounting information for non-gLite sites • Deploy at least one site running Secure Storage • Test a deployment of BeeFS at UNIANDES KoM – 23/09/2010 – San Luis de Potosí, Mexico
Milestones for the 1st Year (2/2) • By the end of December, 2010 (M4) • Deliver first version of tool to deploy customized clusters • By the end of February, 2011 (M6) • Deploy several sites running Secure Storage • Upgrade gLite application-oriented services to gLite 3.2 • By the end of April, 2011 (M8) • Deploy at least one production site running BeeFS and BashReduce • By the end of July, 2011 (M11) • Deploy version of customized virtual clusters with single image deployment and dynamic IP assignment • Deploy Secure Storage in all gLite production sites KoM – 23/09/2010 – San Luis de Potosí, Mexico
Thanks for your attention Any questions? KoM – 23/09/2010 – San Luis de Potosí, Mexico