1 / 21

Information & Monitoring Services

Information & Monitoring Services. Antony Wilson WP3, RAL a.j.wilson@rl.ac.uk. Introduction. information systems – LDAP (Lightweight Directory Access Protocol) Ftree Globus MDS information providers RPMs configuration starting ftree configuration of the GRIS/GIIS registration

meena
Download Presentation

Information & Monitoring Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Information & MonitoringServices Antony Wilson WP3, RAL a.j.wilson@rl.ac.uk

  2. Introduction • information systems – LDAP (Lightweight Directory Access Protocol) • Ftree • Globus MDS • information providers • RPMs • configuration • starting ftree • configuration of the GRIS/GIIS registration • starting Globus MDS • example searches • summary

  3. LDAP Information Systems • 2 configuration files • /etc/edg/info-mds.conf • /etc/globus.conf • info-mds.conf • configuration of the information providers • globus.conf • configuration of Globus MDS • includes registration details

  4. Information Providers - RPMs • configuration • edg-info-main-*.i386.rpm • computing element information provider • CEInformationProviders-*.i386.rpm • netmon information provider • edg-info-netmon-*.i386.rpm • storage element information provider • edg-info-se-*.i386.rpm • replica catalogue information provider • edg-info-rc-*.i386.rpm

  5. Information Providers - Configuration • configuration via /etc/edg/info-mds.conf • generic information • site information provider • computing element information provider • netmon information provider • storage element information provider • replica catalogue information provider • static data via /opt/edg/info/mds/etc/ldif/*.ldif • computing element • replica catalogue

  6. info-mds.conf - Generic WP3_DEPLOY=/opt/edg/info/mds FTREE_INFO_PORT=2171 FTREE_DEBUG_LEVEL=0 # the default value is "Mds-Vo-name=local,o=grid“ SITE_DN=Mds-Vo-name=local,o=grid

  7. info-mds.conf - Site • Note this is usually combined with computing element SITE_INFO=yes SITE_NAME=RAL SITE_INSTALLATION_DATE=20011115123410Z SITE_SYSADMIN_CONTACT=grid.sysadmin@gridpp.rl.ac.uk SITE_USER_SUPPORT_CONTACT=grid.support@gridpp.rl.ac.uk SITE_SECURITY_CONTACT=grid.security@gridpp.rl.ac.uk SITE_DATAGRID_VERSION=1 SITE_NETMON_HOST=gppnetmon.gridpp.rl.ac.uk # comma separated list with no spaces SITE_SE_HOSTS=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces SITE_CE_HOSTS=gppce05.gridpp.rl.ac.uk

  8. info-mds.conf – Computing Element CE_PRESENT=yes CE_HOST=gppce05.gridpp.rl.ac.uk CE_BATCHSYSTEM=pbs CE_CLUSTER_BATCH_SYSTEM_BIN_PATH=/usr/pbs/bin # comma separated list with no spaces CE_QUEUE=workq # comma separated list with no spaces CE_CLOSE_SE_ID=gppse05.gridpp.rl.ac.uk # comma separated list with no spaces, these values must relate to the corresponding CLOSE_SE_ID CE_CLOSE_SE_MOUNT_POINT=data

  9. info-mds.conf – Netmon • This will be changing in the next release • This is also usually combined with computing element NETMON_PRESENT=yes NETMON_PINGER_HOST=gppnetmon.gridpp.rl.ac.uk

  10. info-mds.conf – Storage Element SE_PRESENT=yes SE_ID=gppse05.gridpp.rl.ac.uk SE_SIZE=500000 SE_CONTACT=grid.support@gridpp.rl.ac.uk SE_TYPE=disk # comma separated list with no spaces, this is a list of Vos supported by the SE SE_VO=alice,atlas,biomedical,cms,earthob,lhcb # comma separated list with no spaces, values used in df to obtain freespace SE_FILESYSTEMS=/dev/hda2,/dev/hda4 # comma separated list with no spaces SE_CLOSE_CE=gppce05.gridpp.rl.ac.uk:2119/jobmanager-pbs-workq # comma separated list with no spaces SE_PROTOCOLS=gridftp,rfio,file # comma separated list with no spaces, these values must relate to the corresponding SE_PROTOCOLS SE_PROTOCOL_PORTS=2811,3147,

  11. info-mds.conf – Replica Catalogue RC_PRESENT=yes RC_HOST=gpprc05.gridpp.rl.ac.uk # comma separated list with no spaces RC_VO=alice,atlas,biomedical,cms.earthob,lhcb

  12. Static Information – Computing Element • makes use of static information • /opt/edg/info/mds/etc/ldif/ce-static.ldif • this will be changing to /opt/edg/etc/info/mds/ce-static.ldif • ldif file can be customized for a queue • /opt/edg/info/mds/etc/ldif/ce-static-queuename.ldif Architecture: intel OpSys: RH 6.2 MinPhysMemory: 512 MinLocalDiskSpace: 24000 NumSMPs: 2 MinSPUProcessors: 2 MaxSPUProcessors: 2 AverageSI00: 450 MinSI00: 450 MaxSI00: 450 RunTimeEnvironment: CMS4.2 RunTimeEnvironment: ATLAS1.1 AFSAvailable: FALSE OutboundIP: TRUE InboundIP: TRUE The architecture of the hosts composing the CE The operating system of the hosts composing the CE The minimum value of the physical memory among the hosts composing the CE The minimum local disk footprint Number of SMP hosts The minimum number of SPU processors (for SMP hosts) The Maximum number of SPU processors (for SMP hosts The Average of the SpecInt2000 benchmark of the nodes associated with the CE The minimum value of the SpecInt2000 benchmark of the nodes associated with the CE The maximum value of the SpecInt2000 benchmark of the nodes associated with the CE A List of software/packages installed on this CE A List of software/packages installed on this CE Defines if AFS is installed Defines if outbound connectivity is allowed Defines if inbound connectivity is allowed

  13. Static Information – Replica Catalogue • makes use of static information • /opt/edg/info/mds/etc/ldif/rc-static.ldif • this will be changing to /opt/edg/etc/info/mds/rc-static.ldif • ldif file can be customized for a virtual organization • /opt/edg/info/mds/etc/ldif/rc-static-vo.ldif Rcport: 2001 RCmanagerDN: cn=manager,rc=AliceReplicaCatalogue,dc=eu-datagrid,dc=org Rcurl: ldap://grid-vo.nikhef.nl:10389/rc=AliceReplicaCatalog,dc=eu-datagrid,dc-org

  14. Starting Ftree • /etc/rc.d/init.d/edginfo-mds • start • stop • restart • status • use information provided in /etc/edg/info-mds.conf • produces 2 ldif files • one for ftree • one for Globus MDS • both point to the same information providers • starts/stops ftree

  15. Configuration of the GRIS/GIIS Registration • GRIS Grid Resource Information Server • GIIS Grid Index Information Server • there is a GRIS on any machine running an information provider • there is a GIIS at site level • the GRIS’s register with the site GIIS • the site GIIS registers with the country GIIS/VO GIIS • registration is controlled via /etc/globus.conf

  16. globus.conf - Resource GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk

  17. globus.conf - Site GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=ral GRID_INFO_GRIS_REG_HOST=gppce05.gridpp.rl.ac.uk GRID_INFO_GIIS_1=ral #Register with the country GIIS GRID_INFO_REG_GIIS_1=uk GRID_INFO_REG_HOST_1=gppinfo.gridpp.rl.ac.uk

  18. globus.conf - Country GRID_INFO_DEBUG_LEVEL=0 GRID_INFO_USER=infouser GRID_INFO_GRIS=yes GRID_INFO_EDG=yes GRID_INFO_GRIS_REG_GIIS=uk GRID_INFO_GRIS_REG_HOST=gppinfo.gridpp.rl.ac.uk GRID_INFO_GIIS_1=uk #Register with the top level GIIs for the testbed GRID_INFO_REG_GIIS_1=datagrid GRID_INFO_REG_HOST_1=lxshare0225.cern.ch

  19. Starting Globus MDS • /etc/rc.d/init.d/globus-mds • start • stop • restart • status • use information provided in /etc/globus.conf • starts/stops Globus MDS

  20. Example Searches • Ftree is on port 2171 • Globus MDS is on 2135 • search a resource: ldapsearch -x -H ldap://gppse05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-name=local,o=grid‘ objectclass=* • search a site: ldapsearch -x -H ldap://gppce05.gridpp.rl.ac.uk:2135-b 'Mds-Vo-name=ral,o=grid‘ objectclass=* • search a country/VO: ldapsearch -x -H ldap://gppinfo.gridpp.rl.ac.uk:2135-b 'Mds-Vo-name=uk,o=grid‘ objectclass=* • or use an LDAP browser such as mapcentre as provided by WP7 • http://ccwp7.in2p3.fr/mapcenter/

  21. Summary • edit • /etc/edg/info-mds.conf • /etc/globus.conf • /opt/edg/info/mds/etc/ldif/*.ldif • this will be changing to /opt/edg/etc/info/mds/*.ldif • produce ldifs and start ftree • /etc/rc.d/init.d/edginfo-mds • start Globus MDS • /etc/rc.d/init.d/globus-mds • documentation available at: • http://hepunx.rl.ac.uk/edg/wp3/

More Related