1 / 99

Landing in the Right Nest: New Negotiation Features for Enterprise Environments

Discover new negotiation features tailored for demanding users in enterprise environments using Condor. Learn how to ensure resources land in the right group's nest with strategies like fair share and user priority management.

cbright
Download Presentation

Landing in the Right Nest: New Negotiation Features for Enterprise Environments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Landing in the Right Nest:New Negotiation Features for Enterprise Environments Jason Stowe

  2. New Features for Negotiation

  3. Experience in Enterprise Environments

  4. What is an Enterprise Environment?

  5. Any Organization Using Condor with

  6. Demanding Users

  7. Demanding Users

  8. Organization = Groups of Demanding Users

  9. Purchased Computer Capacity

  10. GuaranteedMinimum Capacity

  11. Need As Many as Possible

  12. As Soon as they submit

  13. Vanilla/Java Universe

  14. Avoid Preemption

  15. How do we ensure Resources land in the right Group’s Nest?

  16. A valid definition ofEnterprise Condor Users?

  17. I started off as a Demanding User

  18. Follow up to earlier work

  19. Condor Week 2005

  20. Condor for Movies:75+ Million Jobs 1000+ CPUs (Linux/OSX)70+ TB storage

  21. (Project that added AccountingGroups)

  22. Condor Week 2006

  23. Web-based Management Tools, Consulting, and 24/7 Support

  24. A Conversation with Miron

  25. Bob Nordlund’s idea for Condor += Hooks

  26. Configuration with PipesCONDOR_CONFIG = cat /opt/condor/condor_config |(Condor 6.8)

  27. Demanding Condor Uses for Banks/Insurance Companies => This year, new features

  28. Negotiation Policies to ManageNumber of Resources

  29. For Groups and Users

  30. What are the Requirements?

  31. -Guaranteed Minimum Quota-Fast Claiming of Quota-Avoid Unnecessary Preemption

  32. Three Common Ways

  33. “Fair share” User PriorityPREEMPTION_REQUIREMENTS

  34. Machine RANK

  35. AccountingGroups GROUP_QUOTA

  36. Generally these are a progression

  37. Story of a Pool

  38. Fair-Share, User Priority

  39. It Works! More Users…

  40. condor_userprio –setfactor A 2 condor_userprio –setfactor B 2

  41. PREEMPTION_REQUIREMENTS = RemoteUserPrio > SubmittorPrio

  42. Works Well in Most cases

  43. Suppose A has all 100 machines, and B submits 100 jobs

  44. User Priorities Cached at Beginning of Negotiation And not updated…

  45. PREEMPTION_REQUIREMENTS = RemoteUserPrio > SubmittorPrio

  46. Standard Universe = No Problem (Preemption doesn’t lose work)

More Related