1 / 40

Pre-Production Service in EGEEIII: a new service for new use cases

Pre-Production Service in EGEEIII: a new service for new use cases. Antonio Retico. Credits: HEP VOs contact people: Patricia Mendez, Roberto Santinelli, Vincenzo Miccio, Roberto Santinelli Pilot Coordinators: Ulrich Schwickerath, Gianni Pucciani Graphic support: Judit Novak

isadora-jacobson
Download Presentation

Pre-Production Service in EGEEIII: a new service for new use cases

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Pre-Production Service in EGEEIII: a new service for new use cases Antonio Retico Credits: HEP VOs contact people: Patricia Mendez, Roberto Santinelli, Vincenzo Miccio, Roberto Santinelli Pilot Coordinators: Ulrich Schwickerath, Gianni Pucciani Graphic support: Judit Novak Sites: All Site Administrators supporting pilots 4th EGEE User Forum – Catania – 5-Mar-2009

  2. Contents Good afternoon! The EGEE pre-production service (PPS) today • How did we get there? Our interface to user world • Pilot services: what, why and how? Some use cases • Recent experiences with HEP VOs 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  3. The EGEE pre-production today How did we get there? 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  4. Mandate in EGEEIII The EGEE Pre-Production provides on-demand access to grid services in preview to WLCG/EGEE users, in order to test, evaluate and give feedback to changes and new features of the middleware. In addition to that, the pre-production extends the middleware certification activity, helping to evaluate deployment procedures, [inter]operability and basic functionality of the software against operational scenarios reflecting real production conditions 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  5. the pre-production by the book PPS (SA1) Certification (SA3) Development (JRA1) Production (SA1) Pre-production “on-demand”? Common practice for IT service providers • Delivery: gaining experience with early users • Operations: protection of the production system Not a concept invented by EGEE 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  6. EGEE I- EGEE II 2004-2008 The way we were 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  7. EGEE1-We started by the book … 2004-2005 OPS manager Production Service Production Service on one grid 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  8. EGEE1-We started by the book … 2005-2006 OPS manager Production Service PPS manager Pre-Production Service Production Service on one grid Preproduction service on another 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  9. EGEE1-We started by the book … 2005-2006 OPS manager Production Service PPS manager Pre-Production Service Production Service on one grid Preproduction service on another Totally independent 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  10. EGEEII - we run for two years 2006-2007 OPS manager Production Service PPS manager Pre-Production Service waiting for users ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  11. EGEEII - we run for two years 2006-2007 OPS manager Production Service PPS manager Pre-Production Service waiting for users ... ... mostly in vain ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  12. EGEEII - we run for two years 2006-2007 OPS manager Production Service PPS manager Pre-Production Service waiting for users ... ... in vain ... very few interactions with users 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  13. Poor usage: symmetry matters VO contact 2006-2007 OPS manager Production Service User Integration framework PPS manager Pre-Production Service VOs use submission frameworks 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  14. Poor usage: symmetry matters VO contact 2006-2007 OPS manager Production Service User Integration framework PPS manager Pre-Production Service VOs use submission frameworks need a second one to access PPS 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  15. Poor usage: symmetry matters VO contact 2006-2007 OPS manager Production Service User Integration framework PPS manager Pre-Production Service VOs use submission frameworks need a second one to access PPS no way 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  16. Poor usage: data matters too 2006-2007 OPS manager Production Service VO contact User Integration framework PPS manager Pre-Production Service OK for stateless operations 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  17. Poor usage: data matters too 2006-2007 OPS manager Production Service VO contact User Integration framework PPS manager Pre-Production Service OK for stateless operations need for synchronised datasets 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  18. Poor usage: data matters too 2006-2007 OPS manager Production Service VO contact User Integration framework PPS manager Pre-Production Service OK for stateless operations need for synchronised datasets OPS! there is a wall 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  19. Alternative: pilot in production VO contact 2007-2008 pilot installation in production OPS manager Production Service User Integration framework PPS manager Pre-Production Service • New WMS service deployed and tried in production 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  20. Alternative: pilot in production VO contact 2007-2008 pilot installation in production OPS manager Production Service User Integration framework PPS manager Pre-Production Service • New WMS service deployed and tried in production • Good success (audience and critics) 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  21. EGEE III 2008-2010 The way we are 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  22. The Pilot Services 2008-... VO contact OPS manager Production Service set-up on demand 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  23. The Pilot Services 2008-... VO contact pilot coordinator OPS manager Production Service set-up on demand coordinated as individual projects 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  24. The Pilot Services 2008-... VO contact pilot coordinator OPS manager Production Service set-up on demand coordinated as individual projects supported by a pool Developers,testers, operators ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  25. The Pilot Services 2008-... pilot installations in production VO contact pilot coordinator OPS manager Production Service set-up on demand coordinated as individual projects supported by a pool programmed layout, lifetime and goals Developers,testers, operators ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  26. The Pilot Services 2008-... pilot installations in production VO contact pilot coordinator OPS manager Production Service set-up on demand coordinated as individual projects supported by a pool programmed layout, lifetime and goals services deployed “a la carte” Developers,testers, operators ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  27. The Pilot Services 2008-... pilot installations in production VO contact pilot coordinator OPS manager Production Service The EGEE preproduction TODAY set-up on demand coordinated as individual projects supported by a pool programmed layout, lifetime and goals services deployed “a la carte” Developers,testers, operators ... 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  28. Our interface to user world Pilot services: what, why and how? 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  29. What’s a Pilot Service? Main interface with the user communities grid services deployed with in an “ad hoc” layout Based on not “officially” released software Deployed and operated in the production environment in a controlled way Supported by several different teams • Certification • Release management, • Grid operations • Site admins Declared objectives Fixed-term duration 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  30. Why on-demand? “General-purpose” PPS not flexible enough Promote usage by adapting to the users’ needs • Can bring to very peculiar configurations Pilot services are really work-intensive • Various teams  Coordination Hence the offer on-demand • Not all the changes need piloting 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  31. Who decides? Many tables: • PMB, TMB, GDB, EMT, OCC … … But the User’s voice is the most important • Pilots without users are nonsense • EGEE user communities can request pilots at all times Contact us • pps-support@cern.ch 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  32. Parallelism in a pilot dev + int preliminary deployability test pilot day-0 set-up pilot user testing Continue? Y | N t 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  33. Some use cases Recent experiences with HEP VOs 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  34. 4 pilots (out of 7) 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  35. CREAM CE 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  36. SLC5 WN 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  37. WMS3.1 (“megapatch”) 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  38. glexec/SCAS 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  39. For Further Reading • WLCG/EGEE Pre Production: Use Cases (EGEEIII) https://twiki.cern.ch/twiki/bin/view/LCG/PreProductionUseCases • WLCG/EGEE Pre Production: Service Description (EGEEIII) https://twiki.cern.ch/twiki/bin/view/LCG/PreProductionServiceDescription • Live pilot services http://www.cern.ch/pps/index.php?dir=./MPS/ • All Available on the PPS web site www.cern.ch/pps 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

  40. Questions? ? 4th EGEE User Forum - 2/6 Feb 09 - Catania (IT)

More Related