1 / 18

Hands on Information System

Learn how to use ldapsearch and lcg-infosites commands to query Grid Information System for CE and SE information. Practice exercises included.

rcandelaria
Download Presentation

Hands on Information System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Hands on Information System Virginia Martín-Rubio Pascual virginia.martinrubio@rediris.es RedIRIS/Red.es Curso Grid y e-Ciencia 2010, Valencia 6- 9 Julio 2010

  2. BDII BDII – MDS: • ldapsearch:LDAP query tool. • lcg-infosites y lcg-info: high level tools for querying Information System.

  3. ldapsearch 1/2 LDAP query to a specific node (LDAP server), the hostname and the TCP port number where the server is listening (usually 2170) are needed: ldapsearch –x –H <ldap_uri> -b “search_point” <options> ‘(filters)’ <GLUEparameters> • Example: $ ldapsearch –x –H ldap://lcg2bdii.ific.uv.es:2170 –b“mds-vo-name=local, o=grid” EXERCISE 1: Get the ‘GlueCEUniqueID’ parameter for the available CEs for the vo.formacion.es-ngi.eu VO users inside IFCA site.

  4. ldapsearch 2/2 EXERCISE 1: Get the ‘GlueCEUniqueID’ parameter for the available CEs for the vo.formacion.es-ngi.eu VO users inside IFCA site. $ ldapsearch -H ldap://lcg2bdii.ific.uv.es:2170 -b 'mds-vo-name=local,o=grid' -x -LLL '(&(GlueCEUniqueID=*ifca.uv.es*)(GlueCEAccessControlBaseRule=VO:vo.formacion.es-ngi.eu))' GlueCEUniqueID dn: GlueCEUniqueID=gridce01.ifca.es:2119/jobmanager-sge-ngifor,Mds-Vo-name=IFC A-CSIC,Mds-Vo-name=local,o=grid GlueCEUniqueID: gridce01.ifca.es:2119/jobmanager-sge-ngifor 4

  5. closeSE The information related to number of CPUs, running jobs and CEs names are provided. ce The names of the SEs supported by the user’s VO together with the kind of Storage System, the used and available space are provided. se lfc Name of the LFC catalog for the user’s VO. all It groups together the information provided by CE, SE, LFC. help Show the available options. lcg-infosites 1/4 • The lcg-infosites command can be used as an easy way to retrieve information on Grid resources for most use cases. lcg-infosites --vo vo option <--is bdii> • The vo and option are mandatory • The –isparameter specifies the BDII to query, if not specified the BDII is defined by default by the environmental variable LCG_GFAL_INFOSYS Option list: The names of the CEs where the user’s VO is allowed to run together with their corresponding closest SEs are provided.

  6. lcg-infosites 2/4 EXERCISE 2: ListtheavailableCEs in thevo.formacion.es-ngi.eu VO.

  7. lcg-infosites 2/4 EXERCISE 2: ListtheavailableCEs in thevo.formacion.es-ngi.eu VO. #[tut25@cg02 ~]$ lcg-infosites --vovo.formacion.es-ngi.eu ce #CPU Free Total Jobs RunningWaitingComputingElement ---------------------------------------------------------- 1 1 0 0 0 ce.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor 156 156 2 0 2 ce2.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor 156 156 2 0 2 ce3.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor 56 56 0 0 0 ce-sge-ngi.ceta-ciemat.es:2119/jobmanager-lcgsge-ngiform 22 22 0 0 0 ce-ieg.bifi.unizar.es:2119/jobmanager-lcgpbs-formangi 248 188 0 0 0 ce-iber.bifi.unizar.es:2119/jobmanager-lcgpbs-formangi 1616 1616 0 0 0 gridce01.ifca.es:2119/jobmanager-sge-ngifor 8 7 0 0 0 e-ce.iaa.es:2119/jobmanager-lcgpbs-forngi 448 448 0 0 0 ce.iaa.csic.es:2119/jobmanager-lcgpbs-forngi 0 0 0 0 444444 ngiesce.i3m.upv.es:2119/jobmanager-pbs-ngies 103 45 4 4 0 ce01.macc.unican.es:2119/jobmanager-lcgpbs-grid

  8. lcg-infosites 3/4 EXERCISE 3: ListtheavailableSEs in thevo.formacion.es-ngi.eu VO.

  9. lcg-infosites 3/4 EXERCISE 3: ListtheavailableSEs in thevo.formacion.es-ngi.eu VO. [tut25@cg02 ~]$ lcg-infosites --vovo.formacion.es-ngi.eu se AvailSpace(Kb) UsedSpace(Kb) TypeSEs ---------------------------------------------------------- 302112763 1130427200 n.a se2.egee.cesga.es n.a 214693056 n.a griddpm01.ifca.es n.a 214693056 n.a griddpm01.ifca.es 232960000 7 n.a e-se.iaa.es 232960000 7 n.a e-se.iaa.es 302112763 1130427200 n.a se2.egee.cesga.es 1000 n.an.astorm.ifca.es 1000 n.an.astorm.ifca.

  10. lcg-infosites 4/4 EXERCISE 5: ListtheavailableCEstogetherwiththeclosest SE in thevo.formacion.es-ngi.eu VO.

  11. lcg-infosites 4/4 EXERCISE 5: ListtheavailableCEstogetherwiththeclosest SE in thevo.formacion.es-ngi.eu VO. [tut25@cg02 ~]$ lcg-infosites --vovo.formacion.es-ngi.eucloseSE Nameofthe CE: ce.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor se2.egee.cesga.es se2.egee.cesga.es Nameofthe CE: ce2.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor se2.egee.cesga.es se2.egee.cesga.es Nameofthe CE: ce3.egee.cesga.es:2119/jobmanager-lcgsge-GRID_ngifor se2.egee.cesga.es se2.egee.cesga.es Nameofthe CE: ce-sge-ngi.ceta-ciemat.es:2119/jobmanager-lcgsge-ngiform Nameofthe CE: ce-ieg.bifi.unizar.es:2119/jobmanager-lcgpbs-formangi Nameofthe CE: ce-iber.bifi.unizar.es:2119/jobmanager-lcgpbs-formangi griddpm01.ifca.es griddpm01.ifca.es Nameofthe CE: gridce01.ifca.es:2119/jobmanager-sge-ngifor […]

  12. lcg-info 1/4 • The lcg-info command can list ce or se according to more complicated conditions. • List the CEs and SEs which satisfy a given query together with the specified attributes. lcg-info --vo vo option --query query --attrs attrs • The environmental variable LCG_GFAL_INFOSYS contains the BDDI name to query, for example: ”top-bdii.rediris.es:2170” • The query syntax is : “attr1=valor1,...,attrN=valorN”, where attrN is the attribute name. • The different conditions must be separated by commas, without blanks. • The query will be the logical AND between all the specified conditions.

  13. --list-attrs Prints a list of the attributes that can be queried. Lists the CEs which satisfy a query, or all the CEs if no query is given. --list-ce --list-se Lists the SEs which satisfy a query, or all the SEs if no query is given --query Restricts the output to the CEs (SEs) which satisfy the given query. --bdii Allows to specify a BDII in the form. If not given, the value of the environmental variable LCG_GFAL_INFOSYS is used. If that is not defined, the command returns an error. --sed Prints the output in a "sed-friendly” format. --attrs Specifies the attributes whose values should be printed. --vo Restricts the output to CEs or SEs where the given VO is authorized. Mandatory when VO-dependent attributes are queried upon. lcg-info 2/4 Lista de opciones:

  14. lcg-info 3/4 EXERCISE 6: Getthelistofsupportedattributes.

  15. lcg-info 3/4 EXERCISE 6: Getthelistofsupportedattributes. [tut25@cg02 ~]$ lcg-info --list-attrs AttributenameGlueobjectclassGlueattributename WorstRespTimeGlueCEGlueCEStateWorstResponseTime CEAppDirGlueCEGlueCEInfoApplicationDir TotalCPUsGlueCEGlueCEInfoTotalCPUs MaxRunningJobsGlueCEGlueCEPolicyMaxRunningJobs CE GlueCEGlueCEUniqueID WaitingJobsGlueCEGlueCEStateWaitingJobs MaxCPUTimeGlueCEGlueCEPolicyMaxCPUTime LRMSVersionGlueCEGlueCEInfoLRMSVersion MaxTotalJobsGlueCEGlueCEPolicyMaxTotalJobs CEStatusGlueCEGlueCEStateStatus LRMS GlueCEGlueCEInfoLRMSType CEVOsGlueCEGlueCEAccessControlBaseRule AssignedJobSlotsGlueCEGlueCEPolicyAssignedJobSlots FreeCPUsGlueCEGlueCEStateFreeCPUs RunningJobsGlueCEGlueCEStateRunningJobs EstRespTimeGlueCEGlueCEStateEstimatedResponseTime […]

  16. lcg-info 4/4 EXERCISE 7: ListalltheCEsthatsatisfy a givenquery: forexampleits total numberofCPUsmust be equalto 1616.

  17. lcg-info 4/4 EXERCISE 7: ListalltheCEsthatsatisfy a givenquery: forexampleits total numberofCPUsmust be equalto 1616. [virginia@gilda-ui ~]$ lcg-info–-vovo.formacion.es-ngi.eu --list-ce --queryTotalCPUs=1616 --attrsRunningJobs,FreeCPUs - CE: gridce01.ifca.es:2119/jobmanager-sge-ngifor - RunningJobs 0 - FreeCPUs 1616 - RunningJobs 0 - FreeCPUs 6

  18. Thanks for your attention! Questions?

More Related