1 / 9

MND review

MND review. Julia Andreeva on behalf of the MND section. Major Achievements in 2009. October analysis excersise. Dashboard applications are widely used by the LHC experiments, in particular by ATLAS and CMS. Example : CMS Dashboard Almost 4K unique visitors in

karim
Download Presentation

MND review

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MND review Julia Andreeva on behalf of the MND section

  2. Major Achievements in 2009 October analysis excersise GS Group meeting, 10-11-2009 Dashboard applications are widely used by the LHC experiments, in particular by ATLAS and CMS. Example : CMS Dashboard Almost 4K unique visitors in October, more than 1.5 million pages were accessed Multiple new features added Applications are used for ATLAS and CMS computing shifts Get on board analysis users (CMS Task monitoring) 100-180 CMS analysis physicists daily use Task monitoring

  3. Major achievements in 2009 Considerable progress in development and deployment of the applications providing high level view , both at the global WLCG scope and at the level of a single site (Siteview, Google Earth for the LHC experiments) Applications for site administrators and VO support teams at the sites are becoming more and more popular (Dashboard SAM portal, Site Status Board, Dataset monitoring for CMS) First prototype of the Dashboard FTS monitor was developed. Ricardo’s proposal for integration of multiple ATLAS monitoring systems was well accepted by ATLAS community. Work is ongoing, Ricardo is coordinating this activity Further development of the Dashboard framework. Use of Google Web Toolkit inside the framework First application for improvement of the failure diagnostics based on the association rule mining deployed for CMS Providing service management for elog services, which became very popular (20 logbooks, 480 users, 22K entries) Providing service management for message brokers which are used by many teams GS Group meeting, 10-11-2009

  4. Main directions of work for the next year Development, deployment, maintenance and support of the Dashboard monitoring applications for the LHC experiments Main effort will be concentrated on the generic applications (Generic Dashboard job monitoring, FTS monitoring, SSB, Dashboard SAM portal) Use generic solutions for technical implementation, for example use MSG as a message bus. Collaboration with the middleware development teams, FTS developers , GridView in order to enable generic monitoring for data transfer, job processing and site availability on the WLCG scope Integration of the VO-specific monitoring systems aimed to provide high-level view of the LHC computing activities on the WLCG infrastructure GS Group meeting, 10-11-2009

  5. Job Monitoring Should follow Grid and application status of user jobs Tasks for the next year: - adapt for all VOs recent improvements done for CMS version of job monitoring - migrate to ActiveMQ messaging (following work started by Kuba’s student ) - provide common way for instrumentation of the VO workload management systems for publishing of the job monitoring information - in collaboration with LB, CEMon, condor_g and GridView development teams enable publishing of the Grid job status information to ActiveMQ messaging system GS Group meeting, 10-11-2009

  6. Data transfer monitoring Dashboard for FTS monitoring • The first prototype uses GWT inside the framework. Is available at CERN for T0 export and T2 instances. • In the beginning of 2010 should be available for general use, should include data from all FTS instances • Further plans • Integrate VO specific information • data subscriptions, file grouping (dataset) GS Group meeting, 10-11-2009

  7. Site monitoring Site Status Board In production for CMS, LHCb and Alice. Currently is actively used by CMS (computing shifts, site commissioning and space monitoring). For LHCb is recently configured for monitoring of the space tokens. Further development is driven by the requests of the suer community VO-specific site availability based on the results of SAM tests Uses information from SAM DB. Includes interface for introducing new availabilities, stored Oracle procedures for availability calculations , some extensions to SAM schema, UI for exposing results of SAM tests and service/site availabilities. Will need to migrate to new SAM schema. Foresee support only for the UI, availability calculations will be provided by GridView. GS Group meeting, 10-11-2009

  8. Integration of VO-specific monitoring systems Coordinate an effort in order to provide high level view of the LHC computing activities on the WLCG infrastructure VO-specific monitoring systems are used as an information source, GoogleEarth or GridMap for visualization, Dashboard framework as a glue to integrate all components in a single system Provide support for SiteView, Google Earth applications. Collaborate with the LHC experiments in order to improve completeness of the reported information New functionality to be enabled: Historical distributions of the numeric and status metrics in the SiteView. Enable navigation to the tickets submitted against the site GS Group meeting, 10-11-2009

  9. Summary Development, maintenance and support of the Dashboard monitoring applications. Many of them are generic and can be used by any VO. Development and support of the Dashboard framework which is used outside Dashboard project, not necessary for the development of the monitoring applications Guidance in instrumentation of the VO-specific systems ( for instance, workload management systems) for publishing of the monitoring data Integration of the VO-specific monitoring systems Contribution to the improvement of the overall WLCG monitoring infrastructure (FTS Dashboard, instrumentation of the GRID services for publishing of the job status information) GS Group meeting, 10-11-2009

More Related