Performance analysis and Monitoring of Grid Applications in CG

1. Być może ta prezentacja wywoła dyskusję, z której wynikną działania do wykonania. Użyj PowerPoint do śledzenia tych działań do wykonania podczas swej prezentacji • Kliknij prawym przyciskiem myszy w trakcie pokazu • Zaznacz polecenie „Notatki ze spotkania” • Zaznacz kartę „Działania do wykonania” • Wpisuj działania do wykonania w miarę ich pojawiania się • Kliknij przycisk OK, aby zamknąć okno • To automatycznie utworzy slajd działań do wykonania na końcu prezentacji wraz z punktami, które wprowadzisz. Seminarium Gridowe Performance analysis and Monitoring of Grid Applications in CG Part II: Monitoring Marian Bubak, Bartosz Baliś, Tomasz Szepieniec and Roland Wismüller

2. Seminarium Gridowe Issues • Application Monitoring (OCM-G) • Complexity of Task 3.3

3. Seminarium Gridowe Monitoring infrastructure Tool Performance Analyser (Task 2.4) Application Process site SM Service Manager node OCM-G LM Local Monitor Application Module AM AP AM AP

4. Seminarium Gridowe Interfaces Tool OMIS site SM node OMIS LM Target interface AP AM AP AM

5. Seminarium Gridowe Very Short Overview of OMIS • Target system view • hierarchical set of objects • nodes, processes, threads • For the Grid: new objects – sites • objects identified by tokens, e.g. n_1, p_1, etc. • Three types of services • information services • manipulation services • event services

6. Seminarium Gridowe OMIS Services • Information services • obtain information on target system • e.g. node_get_info = obtain information on nodes in the target system • Manipulation services • perform manipulations on the target system • e.g. thread_stop = stop specified threads • Event services • detect events in the target system • e.g. thread_started_libcall = detect invocations of specified functions • Information + manipulation services = actions

7. Seminarium Gridowe OMIS Requests Services are combined into two types of monitoring requests: • Unconditional requests • to be executed immediately • executed only once • Conditional requests • to execute actions whenever event occurs • actions can be executed multiple time

8. Seminarium Gridowe OMIS Unconditional Requests :thread_stop(t_1) Actions Operands = stop thread t_1

9. Seminarium Gridowe OMIS Conditional Requests thread_started_libcall(t_1, „MPI_Send”): counter_inc(c_1) Event Operands Actions = whenever thread t_1 invokes MPI_Send, increment counter c_1

10. Seminarium Gridowe Grid- specific OMIS extensions • New objects in the hierarchy: sites • Reflect the complex structure of the Grid • New services • Sites handling • Multi-application support • New metrics • Probes handling • ..

11. Seminarium Gridowe thread_stop([a_1]) P2 P1 P3 thread_stop([p1,p2]) thread_stop([p3]) SM stop stop stop Request distribution TOOL LM LM

12. Seminarium Gridowe Initialization Start-up at any moment Tool site SM Persistent service (daemon) node LM Running only if an AP exist AP AM AP AM Unchanged start-up

13. Seminarium Gridowe Security Issues • OCM-G components handle multiple users, tools and applications • possibility to issue a fake request (e.g., posing as a different user) • authentication and authorization needed • LMs are allowed for manipulations • unauthorized user can do anything

14. Seminarium Gridowe Security - Solutions • LMs are user-bound • Run as user processes • Security ensured by OS mechanisms • Service Managers are permanent • Run as unprivileged processes (nobody) • User Grid Id checked internally (partial security) • Grid certificates for users, tools and SMs incorporated (ultimate security)

15. Seminarium Gridowe OCM-G and Web Services At first, provide only the Registry service Then, OMIS possibly could be moved to OGSA QUESTION: Do we really need this?

16. CG Tool Environment Seminarium Gridowe Legend RMD – raw monitoring data PMD – performance measurement data data flow Benchmarks (Task 2.3) G-PM High Level Analysis Component Applications (WP1) executing on Grid testbed Grid Monitoring (Task 3.3) Performance Measurement Component User Interface and Visualization Component RMD PMD Performance Prediction Component Application source code manual information transfer

17. Seminarium Gridowe CG Task 3.3 Task 3.3: Grid Monitoring

18. Seminarium Gridowe The Monitoring Need • Resource Brokers • Infrastucture • Postprocessing • Statistics • Applications Developing • On-line • Internals

19. Seminarium Gridowe OCM-G Specific • Application Monitoring to support development • No monitoring on default • Secured monitoring object • Interface

20. Seminarium Gridowe CG Task 3.3 Task 3.3: Grid Monitoring Infrastructure Application

21. Dziękujemy za uwagę!