Download
1 / 20
200 likes | 327 Views
Information & Monitoring Services. WP3. Introduction. LDAP R-GMA GRM/PROVE. LDAP. Lightweight Directory Access Protocol Globus’s MDS (Metacomputing Directory Service) Ftree. LDAP -Directory Information Tree. computing element. storage element.
E N D
Introduction • LDAP • R-GMA • GRM/PROVE
LDAP • Lightweight Directory Access Protocol • Globus’s MDS (Metacomputing Directory Service) • Ftree
LDAP -Directory Information Tree computing element storage element network information between this and other sites status file statistics supported protocols storage elements that are close (not necessarily at the same site)
in=siteinfo,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: SiteInfo objectClass: DataGridTop objectClass: DynamicObject siteName: RALDEV sysAdminContact: grid.sysadmin@rl.ac.uk userSupportContact: grid.support@rl.ac.uk siteSecurityContact: grid.security@rl.ac.uk dataGridVersion: 1 installationDate: 20020104142800Z Siteinfo
ceId=dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M,hn=dev01.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=GridceId=dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M,hn=dev01.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: DataGridTop objectClass: ComputingElement CEId: dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M GlobusResourceContactString:dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs:/O=Grid/O=UKHEP/CN=dev01.hepgrid.clrc.ac.uk GRAMVersion: ? Architecture: intel OpSys: RH 6.2 MinPhysicalMemory: 258 MinLocalDiskSpace: 2048 TotalCPUs: 1 FreeCPUs: 1 NumSMPs: 0 MinSPUProcessors: 0 MaxSPUProcessors: 0 TotalJobs: 0 RunningJobs: 0 IdleJobs: 0 IdleJobs: 0 MaxTotalJobs: 1 MaxRunningJobs: 1 WorstTraversalTime: 108000 EstimatedTraversalTime: 0 Active: TRUE Priority: 20 MaxCPUTime: 108000 MaxWallClockTime: 432000 AverageSI00: 300 MinSI00: 300 MaxSI00: 300 AuthorizedUser:/O=Grid/O=UKHEP/OU=hepgrid.clrc.ac.uk/CN=Tim Eves AuthorizedUser:/O=Grid/O=UKHEP/OU=hepgrid.clrc.ac.uk/CN=Tim Folkes RunTimeEnvironment: RALDEV AFSAvailable: FALSE OutboundIP: TRUE InboundIP: FALSE QueueName: M LRMSType: PBS LRMSVersion: OpenPBS_2.3 Computing Element
closeSE=dev02.hepgrid.clrc.ac.uk,ceId=dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M, hn=dev01.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: CloseStorageElement objectClass: DataGridTop objectClass: DynamicObject CEId:dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M ; CloseSE: dev02.hepgrid.clrc.ac.uk MountPoint: /flatfiles Close Storage Element
seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=GridseId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: StorageElement objectClass: DataGridTop objectClass: DynamicObject SEId: dev02.hepgrid.clrc.ac.uk CloseCE: dev01.hepgrid.clrc.ac.uk:2119/jobmanager-pbs-M SEtypearchitecture: disk SEsize: 13177 SEResourceContactString: grid.support@rl.ac.uk SEvo: wpsix Storage Element
seProtocol=gridftp, seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: StorageElementProtocol objectClass: DataGridTop objectClass: DynamicObject SEId: dev02.hepgrid.clrc.ac.uk SEProtocol: gridftp Port: 2811 seProtocol=rfio, seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: StorageElementProtocol objectClass: DataGridTop objectClass: DynamicObject SEId: dev02.hepgrid.clrc.ac.uk SEProtocol: rfio Port: 3147 seProtocol=file, seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: StorageElementProtocol objectClass: DataGridTop objectClass: DynamicObject SEId: dev02.hepgrid.clrc.ac.uk SEProtocol: file Storage Element Protocols
in=status,seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Gridin=status,seId=dev02.hepgrid.clrc.ac.uk,Mds-Vo-name=ral-dev,Mds-Vo-name=uk,o=Grid objectClass: StorageElementStatus objectClass: DataGridTop objectClass: DynamicObject SEfreespace: 12031 SEId: dev02.hepgrid.clrc.ac.uk Storage Element Status
R-GMA • Relational Grid Monitoring Architecture • A relational implementation of the GGF’s GMA • Based upon Java servlets • Consists of Consumers, Producers and a discovery service
Circular BufferProducerServlet Consumer Servlet Consumer Application R-GMA - The Producer Consumer Model Client side Hidden components Circular Buffer Producer Sensor Registry Servlet Schema Servlet command flow Information flow API
R-GMA DataBase Producer • Uses a RDBMS to avoid data loss • Consumer cannot tell the difference • Data inserted like a Circular Buffer Producer • Can produce more than one table DataBaseProducer Servlet RDBMS DataBase Producer Sensor Code
Archiver:Producer/Consumer Utility Archiver Servlet Archiver API ApplicationCode Consumer API Consumer API Consumer API DataBase Producer Consumer Servlet Consumer Servlet Consumer Servlet DataBaseProducer Servlet Producer Servlet Producer Servlet Producer Servlet
R-GMA - API’s • Java, C++, C, Perl & Python API’s • Consumer • Circular buffer producer • Database producer • Archiver
GRM/PROVE • Developed by SZTAKI • originally for monitoring parallel programs in a cluster environment • GRM/PROVE similar to Netlogger • GRM • Provides C API for application monitoring • PROVE • Visualisation tool
GRM/PROVE Instrument the application (GRM lib) Execute in grid Transfer trace file back as a regularoutput file VisualizewithPROVE
GRM/PROVE • Integration with R-GMA • Semi-online model • GRM to uses R-GMA to transport data
Further Information http://hepunx.rl.ac.uk/edg/wp3/
