1 / 10

Tier3 Monitoring TF

Tier3 Monitoring TF. Artem Petrosyan (JINR), Danila Oleynik (JINR), Julia Andreeva (CERN). T3MON proposal (1/3). Finalized at the beginning of 2011. Registered as ATLAS note: http://cdsweb.cern.ch/record/1336119

liang
Download Presentation

Tier3 Monitoring TF

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Tier3 Monitoring TF Artem Petrosyan (JINR), Danila Oleynik (JINR), Julia Andreeva (CERN)

  2. T3MON proposal(1/3) Finalized at the beginning of 2011. Registered as ATLAS note: http://cdsweb.cern.ch/record/1336119 • «T3MON-SITE» - software suite for local site monitoring, based on Ganglia monitoring system • Modules (plug-ins) for local resource management systems (LRMS) and storage systems • Additional plug-ins development for Proof and xRootD • Aggregation and transmission summary data to central monitoring • «T3MON-GLOBAL» - information system for aggregating and visualizing data from distributed Tier3 sites at a global VO • Should be integrated with current ATLAS monitoring system (Dashboard) Work is divided in two streams: validation of standard components and development. ATLAS Software & Computing Workshop

  3. T3MON proposal (2/3) In order to validate T3MON-SITE for different T3 configurations, establishment of a work group at JINR was proposed Tasks: • Deployment of a test cluster • Installation of batch systems and mass storage systems reported as being used at Tier3 sites during T3 survey(various configurations) • Installation and configuration of data file monitoring and inventory • Installation and configuration of Ganglia for a specific cluster setup Installation and validation of the additional Ganglia plug-ins for monitoring metrics collection • Preparation of installation and configuration instructions • Participation in the xRootD federation project within ATLAS ATLAS Software & Computing Workshop

  4. T3MON proposal (3/3) • Milestones • «T3MON-SITE» • Begin of June 2011: first prototype • Middle of July 2011- begin of September 2011: “Alfa” version • September 2011: stable version • «T3MON-GLOBAL» • Begin of June 2011: complete the collection of system requirements • August - September 2011: development and debugging of the publishing agents • October – middle of November 2011: collecting data to the central repository. Integration with the Dashboard monitoring systems • Middle of December 2011: a pilot version, collecting additional information for implementation of the final version • February 2012 – March 2012: a final version. ATLAS Software & Computing Workshop

  5. Team at JINR Involved 4 specialists, 3 young employees, 2 software experts, several volunteers • Software • Artem Petrosyan • Danila Oleynik • Sergey Belov • Vladimir Vasilyev • Installation and validation • Nikolay Kutovskiy • Ignat Lensky, Ivan Kadochnikov, Anatoly Yakshov • Software experts • Lucia Valova (Proof cluster administrator) • Pavel Dmitrienko (local monitoring system administrator/development) ATLAS Software & Computing Workshop

  6. Testbed at JINR • Organized in February 2011 • Multicore nodes • Virtualization • 4 virtual clusters at the moment • PBS • xRootD • PROOF • OGE/SGE • 3 clusters (PBS, xRootD, OGE/SGE) monitored by Ganglia ATLAS Software & Computing Workshop

  7. Status - done + - in progress ATLAS Software & Computing Workshop

  8. Plans • Setting up development infrastructure at CERN: • Development nodes • Repository (SVN) • Common development framework with other application (Dashboard, DQ2) • Twiki documentation • xRootD & Proof plug-ins for Nagios (how to extend monitoring systems for sites which already use Nagios) • Installation & validation: Condor, Lustre ATLAS Software & Computing Workshop

  9. Open issues ATLAS Software & Computing Workshop Monitoring hooks in Athena Collecting more information about list of metrics to be presented on the global level Information about delivery frequency to the global level 05.04.11 9

  10. Summary ATLAS Software & Computing Workshop Proposal is prepared and issued Work group is organized Test infrastructure is set up at JINR Documentation preparation is in process Development of plug-ins is in process 05.04.11 10

More Related