1 / 1

HLRmon accounting portal

A. Cristofori 1 , E. Fattibene 1 , L. Gaido 2 , P. Veronesi 1 INFN-CNAF Bologna (Italy) 1 , INFN-Torino Torino (Italy) 2 hlrmon-lists@to.infn.it - https://dgas.cnaf.infn.it/hlrmon/. HLRmon accounting portal. The accounting layout. Architecture. Collectors retrieve:

amadis
Download Presentation

HLRmon accounting portal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A. Cristofori1, E. Fattibene1, L. Gaido2, P. Veronesi1 INFN-CNAF Bologna (Italy)1, INFN-Torino Torino (Italy)2 hlrmon-lists@to.infn.it - https://dgas.cnaf.infn.it/hlrmon/ HLRmon accounting portal The accounting layout Architecture • Collectors retrieve: • aggregated CPU accounting information from a desired HLR • storage accounting data by probes running on the SRM instances at WLCG sites • values of some GLUE attributes about the computing power capacity of the WLCG • sites • An aggregation layer is responsible for the data manipulation to produce charts and tabular reports visualized by the graphical interface. • Data aggregated per Grid user are directly retrieved from the HLR database at run-time and are just accessible by authorized users. DGAS (Distributed Grid Accounting System) sensors collect accounting information at site level. Site data are sent to site or multi-site HLRs (Home Location Register). A top level HLR receives accounting data from all the Grid HLRs. HLRmon retrieves data from the top level HLR and presents them through a web interface. Aggregated data are also sent to the central EGI Accounting Portal. HLRmon is successfully deployed as accounting portal for IGI and other Grid projects/NGIs using DGAS as accounting system. General purpose CPU reports • Different metrics to analyze: • CPU and Wall Clock Time, expressed in days • and normalized on the mean power capacity of the site • Number of executed jobs • Job efficiency in terms of (CPU Time / Wall Time) ratio • Different keys of data aggregation: • Site • Virtual Organization • VOMS group and role • Certification Authority and Registration Authority • Job type (Grid or local) • Grid user DN • An advanced selection menu permits to choose a desired subgroup of values for each aggregation key. • A specific view with data grouped per discipline is provided: the mapping information between VOs and disciplines is currently retrieved from the EGI Operations Portal. WLCG reports Towards complete storage reports The charts allow the analysis of CPU and storage resources usage at the WLCG Tier1 and Tier2 by the LHC experiments, over the last month and the last year. The resource usage and the amount of pledged resources are compared. Accounting data are grouped by site and by VO. Storage data are taken by a script running on the sites and sent to HLRmon via email. HLRmon provides a storage accounting section for WLCG sites and VOs. A more generalized approach, integrated in DGAS, is being developed. Non-standard schema is used to generate records (no standard schema exists). Records are retrieved at sites and stored on the HLRs. HLRmon is able to retrieve storage information directly from the desired HLR. Each record on the HLR has a timeDurationcalculated as the difference between two consecutive measurements. HLRmon calculates the daily disk consumption in terms of space-per-hour as the integral of the used space over time. Data are aggregated per site, VO and Storage Area.

More Related