Active Monitoring in GRID environments using Mobile Agent technology

1. Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni Università di Catania (ITALY) tomarchio@iit.unict.it andrea.calvagna@iit.unict.it

2. Outline • Monitoring Grid systems • Mobile agents paradigms • Mobile agents and monitoring • MAP: a mobile agents platform • Architecture description • Conclusions

3. Grid Monitoring • The capability of monitoring distributed computational resources effectively is a crucial factor for high-performance distributed computation • As distributed systems become bigger, and more widely distributed, automating the operations of monitoring becomes very important.

4. Grid Monitoring Why is monitoring important? • to find the cause of performance problems • for tuning systems parameters in order to optimize resource usage • fault detection • to build prediction models of performance (used by sophisticated scheduling algorithms) • for billing and accounting

5. Grid Monitoring What are the problems to deal with? • Wasting of resources dedicated to monitoring purposes • Scalability • Possibility to start monitoring application on-demand • Possibility to customize monitoring strategies • Different metrics of measurement data

6. Grid Monitoring with Agents • Mobile code and agents: • basic assumptions and characteristics • Key issues for using mobile agents technology in the monitoring context

7. Mobile Code • The basic idea is allowing to move code to remote sites and execute transferred code there • problems arising from mobility, e.g. • heterogeneity of systems • security (as more parties are involved) • Programming paradigms based on mobile code can be divided according to initiator of code transfer

8. Client Server Client Server local resources Client/server Remote evaluation Server Client local resources local resources local resources Code on Demand Mobile Agents Programming paradigms based on code mobility

9. Mobile Agents • Mobile Agents are program instances that are able move within a network under their own control • mobile agents consist of: • code • data state (i.e. variables) • execution state (i.e. stack) • Some basic capabilities: • able to autonomously migrate between places • able to communicate to each other • some agents offer services or interfaces to legacy applications

10. Application Areas for Mobile Agents • Distributed Information Retrieval • Mobile computing • Distributed Network Management • Collaborative and workflow applications • Active networks • Electronic commerce • Grid monitoring (?)

11. Grid Monitoring with agents: key issues • Customizable algorithms of data analysis dinamically executed on-demand by the user • Reduction of network load • Filtering of monitoring data at several abstraction level without high overheads for the system • Asynchronous and indipendent execution of task • Integration of heterogeneous resource monitoring tools • On-demand enabling of necessary services

12. MAP: a Mobile Agent Platformhttp://sun195.iit.unict.it/MAP/ MAP is a software platform for the development and the management of mobile agents. Its main characteristics are: • It provides an environment in which agents can execute, stop and resume their execution, communicate among them, move on other nodes on the network • It is entirely developed using the Java language, which provides total architecture independence • The platform also provides different programming paradigms for distributed systems, such as remote evaluation and code on demand • In the latest version it has been made MASIF compliant

13. Dynamic Network Class Loading Context Agents Communication Interface MAP architecture Region Region Region Registrator Region Registrator MAP Server MAP Server MAP Server MAP Server

14. Graphic interface for agents’ control and management

15. Main features of MAP • Key features of MAP relevant for Grid systems are: • security • interoperability with different agents’ systems

16. Monitoring Application Other Agents Local Monitoring Application High-Level Monitoring Agents HLMAgents Sensor Agents LLSManager Low-Level Sensors LLSensors Monitoring with agents: System Architecture Directory Service Agent Cache Repository Performance Data Repository Resource

17. Monitoring with agents: Basic components • Low-Level sensors (LLSensors) • SensorAgents • High-Level Monitoring Agents (HLMAgents) • Low-Level Sensor Manager (LLSManager) • Directory Service • Performance Data Repository • Agent Cache Repository

18. Monitoring with agents: Basic components Low-Level sensors (LLSensors) • they are not agents (in general) • specific for each resource • directly interfaced with resources • The Low-Level Sensor Manager deals with their registration in the Directory Service

19. Monitoring with agents: Basic components Sensor Agents • They use the data supplied by the LLSensors for providing uniform informations about the state of a resource • Resources taken into account include: • hosts • network • storage • process/applications

20. Monitoring with agents: Basic components High-Level Monitoring Agents (HLMAgents) • Their task is gathering significant information relying on all the agents present in the system • user or application initiated(e.g. CollectSensorAgent, AggregateAgent) • event-initiated(e.g. TrapAgent)

21. Monitoring with agents: Basic components Directory Service • Basically the Directory Service maintains informations on what kind of Sensors are available for the different resources.

22. Monitoring with agents: Basic components Performance Data Repository • to store the events and data recorded by LLSensors and SensorAgents Agent Cache Repository • a repository of agents that have been executed within the region

23. Piano temporale attività • People • 2 persone al 30% • Orazio Tomarchio • Andrea Calvagna

24. Piano temporale attività • Tasks • task 1M0-M1 Evaluation of mobile agent technology for Grid network monitoring • task 2M0-M2 Use and testing of MAP (Mobile Agent Platform) in a Grid environment (eventually adapt it to new requirements imposed by geographically dispersed environment) • task 3M1-M4Definition of a base architecture for monitoring networks using mobile agents

25. Piano temporale attività • Tasks • task 4 M2-M3 Evaluation of this approach against more traditional approach • task 5 M4-M9 Integration/Interfacing the agent platform with existing low-level tools for gathering network informations. • task 6 M4-M12 Implementation of the proposed approach and experimental measurements and validations.