1 / 17

SRM Monitoring 12 th April 2007 Mirco Ciriello INFN-Pisa

SRM Monitoring 12 th April 2007 Mirco Ciriello INFN-Pisa. Overview. Analysis of existing monitor tools for the various SRM implementations List of a first set of information that can be extracted from current available monitor tools For now only DPM and dCache are analyzed

dashiell-marechal
Download Presentation

SRM Monitoring 12 th April 2007 Mirco Ciriello INFN-Pisa

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SRM Monitoring 12th April 2007 Mirco Ciriello INFN-Pisa

  2. Overview • Analysis of existing monitor tools for the various SRM implementations • List of a first set of information that can be extracted from current available monitor tools • For now only DPM and dCache are analyzed • Analysis of dCache needs more investigations GSSD Meeting 12 April 2007

  3. DPM Existing Tool • www.pi.infn.it/~ciriello/report_dpm.pdf • There are two tools to monitor an istance of DPM • dpm_qryconf: displays the Disk Pool Manager configuration • dpns_getacl: gets the Access Control List associated with a DPNS directory/file GSSD Meeting 12 April 2007

  4. dpm_qryconf 1/3 Gives information for each pool: • The pool name; • The default amount of space reserved for a file; • The threshold (in %) at which the garbage collector is started; • The threshold (in %) at which the garbage collector is stopped; • The default lifetime; • The default pin time; • The maximum lifetime; • The maximum pin time; GSSD Meeting 12 April 2007

  5. dpm_qryconf 2/3 • The File System Selection policy name; • The Garbage Collection policy name; • The Request Selection policy name; • The group id if pool is restricted; • The space type: V (for Volatile), D (for Durable), P (for Permanent); • The Migration Policy name; • The Retention policy: R (for Replica), O (for Output), C (for Custodial); • The capacity of the disk pool; • The amount of free space of the disk pool; GSSD Meeting 12 April 2007

  6. dpm_qryconf 3/3 There is also information on the filesystems belonging to the pool: • The server name; • The filesystem name; • The capacity; • The amount of free space; • The filesystem’s status. GSSD Meeting 12 April 2007

  7. dpns_getacl 1/4 • Gets the ACL associated with a DPNS directory/file • For each path it displays: • The file name; • Owner; • The group; • The Access Control List (ACL) if present. GSSD Meeting 12 April 2007

  8. dpns_getacl 2/4 • The output looks like #file: filename #owner: username #group: groupname user::perm user:uid:perm group::perm group:gid:perm mask:perm other:perm default:user::perm default:user:uid:perm default:group::perm default:group:gid:perm default:mask:perm default:other:perm GSSD Meeting 12 April 2007

  9. dpns_getacl 3/4 • The first user entry gives permissions granted to the owner • The following user entry shows the permissions granted to specific user • The first group entry gives permissions granted to the owner • The following group entry shows the permissions granted to specific group GSSD Meeting 12 April 2007

  10. dpns_getacl 4/4 • The mask entry is the maximum permission granted to specific users or groups • Default entries associated with a directory are inherited as access ACL by the files or sub-directories created in that directory GSSD Meeting 12 April 2007

  11. DPM: other useful information • There is other useful information to know • At the moment there’s no tool for retrieval • Statistics on the performance • Information about the protocol available to access/transport files GSSD Meeting 12 April 2007

  12. DPM Performace’s Information • Amount of reserved space; • Number of transfers for each file; • Number of requests for each file; • Number of requests processed; • Number of movements on each pool; • Number of active users; • Number of files per VO; • Max accessibility latency. GSSD Meeting 12 April 2007

  13. DPM Access protocol’s Information • Type of access protocol; • Network endpoint of the protocol; • Protocol version; • Function supported by the protocol. GSSD Meeting 12 April 2007

  14. dCache Existing Tool • The following analysis needs further investigations • For now I only list some tools: • Every dCache has a status web page running on port 2288, that gives useful information about the PoolManager configuration • Every dCache has a ssh administration interface, that allows the admin to log into dCache, study the components and make real-time changes to the configuration • The new component SRM-watch, provides a detailed graphical view of the current and past SRM transfers to and from the dCache GSSD Meeting 12 April 2007

  15. dCache status web-page • Very useful for someone running a dCache • Unfortunately the information are not in machine readable format • We can recover information on: • Availability and response times of pools; • Pool Space Usage (total, used, cached, sticky); • Pool selection scheme; • Data Transfer Queue from Tapes to disks; • Mover queues per pool; • List of active transfers; • Daily, weekly transfer and repository statistics. GSSD Meeting 12 April 2007

  16. dCache ssh admin interface • It is accessible with the SSH protocol • Provides a more detailed view than webpage • Unfortunately, it is difficult to write scripts for this interface • Useful commands are “info” for general information and ”show pinboard” for list the last lines of the pinboard • Many of the commands are only used for debugging and development purposes GSSD Meeting 12 April 2007

  17. dCache SRM-watch • https://srm.fnal.gov/twiki/bin/view/SrmProject/SrmMonitoring • Java servlet based application • It’s in a prototype stage • It extracts statistical data from SRM database and plot it • It provides web accessible, dynamic views of SRM request states and associated transfers • It provides web accessible, static views of system parameters per day/month/year GSSD Meeting 12 April 2007

More Related