1 / 20

Living on the Edge: OSG Edge Services Framework

Living on the Edge: OSG Edge Services Framework. Kate Keahey Abhishek Rana. Edge Services. Services executing on the edge of the public and private network. ATLAS. CMS. CE. SE. CDF. Guest VO. Site. Compute nodes and Storage nodes. Edge Service Requirements. Configuration Issues

lemuel
Download Presentation

Living on the Edge: OSG Edge Services Framework

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Living on the Edge:OSG Edge Services Framework Kate Keahey Abhishek Rana

  2. Edge Services • Services executing on the edge of the public and private network ATLAS CMS CE SE CDF Guest VO Site Compute nodes and Storage nodes

  3. Edge Service Requirements • Configuration Issues • The configuration requirements can vary widely per Edge Service per community. • We need an easy way to upgrade Edge Services • Alternative Edge Services • Resource allocation issues • Flexibility in dynamically managing resource assignments as load demands fluctuate • Fair usage between communities • Incentives

  4. 1.1 1.0 0.9 0.8 0.7 0.6 0.5 0.4 0.3 0.2 0.1 0.0 L X V U L X V U L X V U L X V U SPEC INT2000 (score) Linux build time (s) OSDB-OLTP (tup/s) SPEC WEB99 (score) Benchmark suite running on Linux (L), Xen (X), VMware Workstation (V), and UML (U) Virtual Machines • Excellent isolation, security, fine-grain forensics… • Promising enforcement properties • More control to the site & great recoverability • Flexible configuration • The ability to serialize and migrate • Modern implementation are fast

  5. Virtual Workspaces • Virtual Workspaces: environments that can be made available dynamically on the Grid • Different possible implementations • Workspace Service • Enables secure deployment and management of a workspace within a trusted computing base • Authentication and authorization • Deployment configuration • Resource allocation enforcement • Workspace = deployment meta-data + image • More information and technology preview download available at http://workspace.globus.org

  6. Edge Service Framework ESF - Phase 1 Edge Service Framework Staging Tools Workspace Service Image Repository Image Information

  7. ESF - Phase 1 Role=VO Admin CMS ESF CE SE Site

  8. ESF - Phase 1 Role=VO Admin CMS ESF CE SE Site

  9. ESF - Phase 1 Role=VO Admin ESF CE SE Site

  10. ESF - Phase 1 Role=VO Admin ESF CE SE Site

  11. ESF - Phase 1 Role=VO Admin ESF CMS CE SE Site

  12. ESF - Phase 1 Role=VO Admin ESF CMS CE SE Site

  13. ESF - Phase 1 Role=VO Admin Remote Entity ESF CMS CE SE Site

  14. ESF - Phase 1 Role=VO User ESF CMS CE SE Site

  15. ESF - Phase 1 Role=VO User ESF CMS CE SE Site

  16. ESF - Phase 1 Role=VO User ESF CMS CE SE Site

  17. ESF - Phase 1 Role=VO User ESF CMS CE SE Site

  18. ESF Project • Phase 1 objective: create a proof-of-concept dynamic deployment of Edge Services • Progress: • Implement and release the Workspace Service • Bubbly test: static deployment and test of a real Edge Service on a production site • Dynamic deployment of an Edge Service and integration into OSG infrastructure • Configuring more testbeds • Deploying and testing more Edge Services

  19. Testbed & Images • Testbed • SDSC (Abhishek) • OSG production site, 150+ worker nodes • Intel 2.6, 4GB, RAID device, Xen 2.0.7 • FNAL (Burt) • Xeon 3.2, 4GB, RAID device, Xen 2.0.7 • UC (Rob, Borja) • TeraPort, Xen 3 • ANL, PIOCON coming online • Images • SDSC: SL3.0.3, FC4, CentOS4.1 • FNAL: SL3.0.3, SL4, LTS 3, LTS 4 • Edge Services • ATLAS: mysql-gsi db built by the DASH project

  20. Summary • Growing ESF testbed • Xen capabilities / ESF requirements • Installation woes getting worked out • Growing library of images with useful configurations • Growing infrastructure • www.opensciencegrid.org/esf

More Related