1 / 13

BQS Update

Architecture Scheduling Job Types. BQS Update. New Users Needs More users & machines, Scalability issues Needs for more sophisticated monitoring and control over the system. Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04. Architecture Update.

maeve
Download Presentation

BQS Update

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Architecture Scheduling Job Types BQS Update • New Users Needs • More users & machines, Scalability issues • Needs for more sophisticated monitoring and control over the system Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  2. Architecture Update MySQL DB DB Agent query BQS Scheduler Client submit DB Agent results spawn report Worker Worker Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  3. Scheduler Resources Quasi Interactive Jobs Scheduling Update Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  4. More Control for Operation and Administration: Weight of Past Resource Usage And Group Objectives Max Job Duration Small Jobs Bias Scheduler Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  5. Beyond Traditional Resources E.G. Disk, Time, Memory Logical Resources Name Max Available Restricted Flag Admin Defined Resources E.G. HPSS Logical Resources Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  6. Created & managed by Users: Decide of the Name: u_XXX Receive Privilege bqs.u_XXXadmin Set Max Available and Restricted Flag Grant/deny bqs.u_XXXusage privilege Logical U_Resource Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  7. A General Service, APIs, Commands To: Grant, Deny, Check & List Privileges Given to Users, Groups and Machines EG in BQS applid: bqs.admin, bqs.oper, bqs.spawn_forbidden Privilege Management Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  8. Parallel Jobs Arborescent Jobs GRID Jobs New Job Types Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  9. 2 new submit options: proc, ptype proc: Number of WorkPoints ptype: PVM, MPICH, LAM-MPI Parallel Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  10. Parallel Jobs query MySQLDB BQS DB Agent Client submit … BQS Master DB DB Agent results spawn parallel job global report spawn task Worker Worker report Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  11. SNOVAE: many related small tasks need short global response time Schedule and spawn as one Job to reduce BQS latency Runs on a number of WorkPoints User must describe tasks dependencies Arborescent Job Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  12. Real and Generic Accounts AFS Tokens and Certificates Specific RH 7.3 + LCG Soft Full Production Farm (Currently a Specific “lcg” Logical Test Farm for Validation) GRID Jobs Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

  13. BIO: Quasi Interactives Jobs Installation and documentation for LCG Other Projects Yves.Fouilhe@in2p3.fr HEPIX Edinburgh 26/5/04

More Related