1 / 24

JBQS presentation

JBQS presentation. IN2P3 Computer Center http: //www.in2p3.fr/CC Campus de la DOUA 27, Boulevard du 11 Novembre 1918 69622 VILLEURBANNE FRANCE. JBQS : Graphical Interface for BQS. Software component for batch management Allows The submission of jobs;

chico
Download Presentation

JBQS presentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. JBQS presentation IN2P3 Computer Center http://www.in2p3.fr/CC Campus de la DOUA 27, Boulevard du 11 Novembre 1918 69622 VILLEURBANNE FRANCE

  2. JBQS : Graphical Interfacefor BQS

  3. Software component for batch management Allows The submission of jobs; The scheduling and execution of jobs on workers; The monitoring of a job. Developed and used at the IN2P3 Computer Centre (France) In October 2000, BQS drives 900 workpoints on; 250 workers and; 10 classes. BQS Summary

  4. Worker : A physical machine where jobs can run. Class : Description of resources such as Amount of CPU, memory, scratch, spool size, etc. Other characteristics such as privileged access, AFS token information. Example : Workers, Classes, Workpoints

  5. Workpoint : Used to get a better control over job production; Defined as a set of orderedclasses allocated to a worker; Runs only one job at a time, but Multiple workpoints on a worker. Example : workpoints definition for ccwasn01 (two processors SUN worker) 1@ccwasn01.in2p3.fr : T,S 2@ccwasn01.in2p3.fr : G,C,A 3@ccwasn01.in2p3.fr : I,R,J,P 4@ccwasn01.in2p3.fr : S,T,I,R Up to 4 jobs can run at the same time for the ccwasn01 worker. About 900 workpoints at the IN2P3 Computer Center. Workers, Classes, Workpoints

  6. A graphical interface for production manager; BQS administrator; on duty staff. Avoidknowledge of BQS Unix command syntax. Allows Graphical query; Resultsdisplay with Editing abilities (finding, sorting, selecting); Interactionsfacilities on single or multiple selections. JBQS design goals

  7. Batch management Production manager Available BQS administration BQS staff Available Batch status, On duty staff Under development Resources optimisation Structure of JBQS

  8. Batch management allows query & control over jobs; workers; workpoints; dispatching authorisation. Queries are made through various criteria from menus. Results interaction with Popup menu allows actions on single or multiples selected cell. Editing abilities allows finding, extracting, sorting. Predefined options such as job type or frequently used command options can be set. Batch management : Description

  9. Batch management : Diagram • Query by: • platform • name Workers Switching ability • Query by: • user • group • platform • worker • class • workpoint • Query by: • platform • worker • name Jobs Workpoints

  10. First example : CPU limit modification on a running job. Second example Draining a set of workers. Screenshots examples

  11. Job query by account Job menu selection Account choice

  12. Job results Job results panel Text-area panel

  13. Action on a job Popup menu for the selected cell Job action choice panel

  14. Multiple workers drain action Worker menu selection Platform choice

  15. Worker results worker results panel Action status

  16. Multiple workers drain action 2) Popup menu for selected cells 1) Selection of multiple workers 3) Worker action panel

  17. Allows modification on all BQS objects i.e. : Farm, platform, machine, workpoint, class and account. Objects can be created or deleted Parameters can be modified and then applied to the object itself; propagated to other selected object. BQS administration description

  18. First example : Default CPUmodification on one class (G). Second example Swap spacemodification on multiple workers. Screenshots examples

  19. Default CPU modification on class G New default AND max CPU values (previous 30,000) Apply new values (default and maxCPU) to the class G

  20. New swap space for multiple workers 2) New Swap Space value (previous 4,000) 1) Selection of multiple workers 3) Button for (only) Swap Space modification

  21. A Java standalone application with BQS calls made through an C API (uses of JNI *). Available on Solaris 2.7 and Linux RH 6.1. On any platform as soon as RMI * functionality is implemented. Multithreaded application for BQS calls, in order to get a better response time. Dynamically dialog boxes generation (thanks to Java). Multiple windows with menus. Text area panel with file Open/Save et Cut/Copy/Paste facilities. * JNI : Java Native Interface. * RMI : Remote Method Invocation. Implementation features

  22. Editing functions for results Finding, Sorting, Selecting RMI * functionality * RMI : Remote Method Invocation. Next implementation

  23. BQS status functionality Worker status; Job running status (dead lock, infinity loops). Batch production flow (in order to optimise) Estimated ending time of running and queued jobs; Workpoints and classes occupation rate. JDBC * implementation in JBQS (After a data-base migration for BQS software) * JDBC : Java Data Base Connectivity Future development

  24. About BQS http://www.in2p3.fr/ CC/interne/pub/bqs/index.html email : fouilhe@cc.in2p3.fr (Yves FOUILHE) chambon@cc.in2p3.fr (Bernard CHAMBON) About CC-IN2P3 http://www.in2p3.fr/CC/ About Java http://www.javasoft.com More information

More Related