180 likes | 305 Views
Service Composition for LHC Computing Grid Monitoring. Beob Kyun Kim e-Science Division, KISTI 2008. 09. 09. 1. Outline. This talk is to introduce service composition approach as a new way to overcome problems on the use of current LCG monitoring. current LCG monitoring services’ problem
E N D
Service Composition for LHC Computing Grid Monitoring Beob Kyun Kim e-Science Division, KISTI 2008. 09. 09 1
Service Composition for LCG Monitoring Outline • This talk is to introduce service composition approach as a new way to overcome problems on the use of current LCG monitoring. • current LCG monitoring services’ problem • requirements of integrated monitoring services • an example of abstract integrated monitoring architecture
Service Composition for LCG Monitoring Introduction • LCG is LHC Computing Grid • 120 institutes, 52 countries, 259 sites (July, 2008) • 72,000 CPUs and 20 PB disks • 274 VOs, 14,000 users • More than 150,000 jobs are being processed • Grid consists of many resources and services too complex to understand and manage if you can not monitor them, you can not manage it. • The purpose of grid monitoring • To improve the reliability of resources • To help resource providers with abstract views on their resources’ status
Service Composition for LCG Monitoring Introduction Example: KISTI ALICE Tier2 Center Is there no way to see all these services’ status in one view ?
Service Composition for LCG Monitoring Introduction Monitoring services for LCG • Availability testing framework – SAM/RSV • Job and Data reliability monitoring – Gridview • Grid topology – GOCDB/Registration DB • Dynamic view of the grid – BDII/CeMon • Accounting – APEL/Gratia • Experiment views – Dashboards • Fabric monitoring – Nagios, LEMON, … • Grid operations tools – CIC Portal
Service Composition for LCG Monitoring Introduction Monitoring services for LCG If new monitoring service ? If we need to watch new aspects of resources ?
Service Composition for LCG Monitoring Example: GOCDB
Service Composition for LCG Monitoring Example: Fabric monitoring with Nagios
Service Composition for LCG Monitoring Introduction Example: MonALISA Repository for ALICE
Service Composition for LCG Monitoring User’s decision rule
Service Composition for LCG Monitoring Requirements for LCG Monitoring Service Platform • Usually, to easily give integrated view of resources and services • Integrated services should be loosely coupled • Basically, monitoring services are loosely coupled, except few of them. • Service integration could be performed in distributed • All services should have a standard interface • Service integration process should be flexible to add and to retrieve entities • Entities include monitoring services and authorized users.
Service Composition for LCG Monitoring Introduction to Service Composition
Service Composition for LCG Monitoring Service Composition for Monitoring • Result of service composition • Integrated monitoring view that consumer requested • Unit services to be used in service composition • Existing monitoring service (SAM, Gridview, GOCDB, BDII, APEL, Dashboards, Nagios, … ) <example> Nagios gStat Service Stat. Service Mon. SAM (page 1) SAM_total SAM (page 2) APEL
Service Composition for LCG Monitoring Service Composition of Monitoring • Security of monitored information • LCG users are authorized based on VO. make it easy to add new users • All services that are critical to security should be aware of VO based authorization. make it easy to add new services <example> User Cert. Nagios VOMS gStat Service Stat. Service Mon. SAM (page 1) GOCDB SAM_total SAM (page 2) APEL
Service Composition for LCG Monitoring Service Composition of Monitoring • Composition rule • A kind of service to give flexibility to user-defined integrated service • Decision function SAM_CR Service_CR CR <example> User Cert. Nagios VOMS gStat Service Stat. Service Mon. SAM (page 1) GOCDB SAM_total SAM (page 2) APEL
Service Composition for LCG Monitoring Service registration and retrieval • Service registration and retrieval are fundamental functions of service composition and execution Service Descriptions Query Parser Service Composition Engine Query Engine VOMS Service Registry Composition Rule X.509 Athentication & Authorization while using Composited Services GOCDB Gridview gStat APEL Nagios SAM New Service
Service Composition for LCG Monitoring Conclusion • To introduce a new way to overcome problems on the use of current LCG monitoring, service composition approach is introduced. • To minimize the complexity of the use and management of LCG, new integrated view of monitoring information is needed. • By the use of service composition approach for LCG monitoring: • Users can have flexibility to build their own monitoring view • Users can add their own decision factor to their monitoring view with Composition Rule • By the use of LCG’s auth. & authorization scheme, users can have the flexibility to add new service and new user.
Service Composition for LCG Monitoring Q&A kyun@kisti.re.kr