gLite Information System

1. gLite Information System E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008

2. Overview Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 • Information System • Adopted Information System • BDII • Querying a BDII • Useful Commands • GLUE Schema • References • Some Exercises

3. Information System • What is? • System to collect information on the state of resources • Used for? • To discover resources of the grid and their nature • Workload management • Monitoring (health status of resources) • How? • Monitoring state of the resources locally and publishing fresh data on the information system • Adopting a data model that must be well known to all components that want to access monitored information • More than one implementation: • BDII (Berkeley DB Information System) • R-GMA (Relational Grid Monitoring Architecture) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

4. Information System (2) • Hierarchical System • Information is collected on the leaves of a hierarchical tree and travels towards the root • Clients can query the hierarchical tree at every level • The higher the level against which queries are made, the older is the obtained information • Collecting info • Pull model (higher level severs periodically query lower level severs) • LDAP query model Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

5. Adopted Information System • BDII (Berkeley DB Information System) • Based on LDAP (Light Direct Access Protocol) servers • Evolution of the Globus Meta Directory System (MDS) • Several layers: • Lower Level: GRIS (Grid Resource Information Server) • Medium Level: GIIS (Grid Index Information Server) • Higher Level: Top BDII (BDII Server) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

6. BDII Stays on top of GIIS sites One for each VO Centralized system Three level of hierarchy Every two minutes a cron-job runs a script and collects info from a list of GIIS sites Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

7. Querying a BDII # ldapsearch -x -h <your_BDII_FQDN> -p 2170 -b mds-vo-name=local,o=grid • Query a BDII server • where the –x option indicates that simple authentication should be used; the –h and –p option precede the hostname and port respectively; and the –b option is used to specify the initial entry for the search in the LDAP tree Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

8. Useful Commands $LCG_GFAL_INFOSYS=<your_BDII_FQDN>:2170 $lcg-infosites –-vo edteam ce #CPU Free Total Jobs Running Waiting ComputingElement ---------------------------------------------------------- 106 106 0 0 0 ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam 36 34 0 0 0 ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam 7 7 0 0 0 eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam 22 22 0 0 0 tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam 22 22 0 0 0 ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam 12 0 0 0 0 ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid 88 48 0 0 0 ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam 24 24 0 0 0 ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam $lcg-infosites –-vo edteam se $lcg-infosites –-vo edteam rb • lcg-infosites • Obtain VO-specific information on existing Grid resources Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

9. Useful Commands (2) $ lcg-info --vo edteam --list-ce • CE: ce-biof.eela.ufrj.br:2119/jobmanager-lcgpbs-edteam • CE: ce-eela.ceta-ciemat.es:2119/jobmanager-lcgpbs-edteam • CE: ce-eela.ciemat.es:2119/jobmanager-lcgpbs-edteam • CE: ce01.eela.if.ufrj.br:2119/jobmanager-lcgpbs-edteam • CE: ce02.lip.pt:2119/jobmanager-lcgsge-edteamgrid • CE: eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam • CE: ramses.dsic.upv.es:2119/jobmanager-lcgpbs-edteam • CE: tochtli.nucleares.unam.mx:2119/jobmanager-lcgpbs-edteam • lcg-info • List either CEs or SEs satisfying a given set of conditions on their attributes, and to print, for each of them, the values of a given set of attributes Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

10. Useful Commands (3) $ lcg-info --list-se –vo edteam --attrs CloseCE - SE: eelaSE1.lsd.ufcg.edu.br - CloseCE eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-eela eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-lhcb eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-edteam eelaCE1.lsd.ufcg.edu.br:2119/jobmanager-lcgpbs-ops lcg-info Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

11. Useful Commands $ lcg-info --voedteam --list-ce --query 'TotalCPUs = 10' --attrs 'RunningJobs,FreeCPUs‘ $ lcg-info --vogilda --list-se -attrs 'AvailableSpace,CloseCE‘ Querying the BDII of another VO: $ lcg-info --voeumed --bdii bdii.isabella.grnet.gr:2170 --list-se --attrs 'AvailableSpace,CloseCE' lcg-info Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

12. GLUE Schema • Grid Laboratory Uniform Environment (GLUE) Schema • Provides a standardized description of a Grid computing system, to enable resources and services to be presented to users and external services in a uniform way • Collaboration effort between EU-DataTAG and US-iVDGL projects • XML Schema • GLUE Schema is being mapped to an XML representation • http://glueschema.forge.cnaf.infn.it Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

13. References • BDII Documentation • https://twiki.cern.ch/twiki/bin/view/EGEE/BDII • https://twiki.cern.ch/twiki/bin/view/LCG/BdiiNotes • LCG-2 User Guide • https://edms.cern.ch/file/454439//LCG-2-UserGuide.html • GLUE Schema • http://infnforge.cnaf.infn.it/glueinfomodel Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

14. Some Exercises • Topic related Wiki pages: • https://grid.ct.infn.it/twiki/bin/view/GILDA/InformationSystems Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

15. Questions… Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008