150 likes | 165 Views
Explore the functionality of MDS-2 service architecture within the Globus Project, including resource registration, dynamic registration protocols, and resource discovery methods. Learn about GRIS providers, LDAP integration, and how to configure information providers.
E N D
Grid Information Services The Globus Project Argonne National LaboratoryUSC Information Sciences Instutute http://www.globus.org/
MDS-2 Service Architecture VO-specific Aggregate Directories discovery (GRIP?) ? A A lookup (GRIP) registration (GRRP) R R R R standard Resource Description services • Dynamic Registration via Reg. Protocol (GRRP) • Resource Inquiry via Info. Protocol (GRIP) • Co-located with resource on network • Resource Discovery (via GRIP or other) • Using GRIP allows resource/directory hierarchy Intro to Grid Computing and Globus Toolkit™
Soft-state Registration • Periodic notification • “Service/resource is available” • Expected-frequency metadata • Automatic directory construction • Add new resources to directory • Invite resources to join new directory • Self-cleaning • Reduce occurrence of “dead” references Intro to Grid Computing and Globus Toolkit™
MDS-2 Implementation • Grid Information Service (GRIS) • Provides resource description • Modular content gateway • Grid Index Information Service (GIIS) • Provides aggregate directory • Hierarchical groups of resources • Lightweight Dir. Access Protocol (LDAP) • Standard with many client implementations • Used for GRIP (and GRRP currently) Intro to Grid Computing and Globus Toolkit™
MDS-2.1 External Software Stack • OpenLDAP 2.0.x (.14) • Implements LDAPv3 protocol • Client and server components • Cyrus-SASL • Generic security • We provide loadable SASL/GSS plugin • Globus GSI • Provides GSS-API interface to PKI • Shared library used by our SASL plugin Intro to Grid Computing and Globus Toolkit™
MDS-2.1 Internal Software • Wrappers/tools • Simplify typical idioms • Feature-specific GRIS providers • Resource-specific information probes • Modular interface to GRIS • LDAP server “backend” modules • GRIS provider dispatch/caching • GIIS implementation • SASL/GSS plugin Intro to Grid Computing and Globus Toolkit™
MDS-2.1 GRIS Providers • grid-info-cpu reports CPU/load info • grid-info-fs reports filesystem info • grid-info-mem reports RAM/VM info • grid-info-net reports NIC/net info • grid-info-os reports OS info • grid-info-platform reports arch. info • grid-info-merged merges all host info* • Extensible for other sources, e.g. GRAM Intro to Grid Computing and Globus Toolkit™
Configuration files for Registration dc-n1.isi.edu grid-info-site-policy.conf grid-info-resource-register.conf grid-info-resource-ldif.conf GIIS GRIS dc-n2.isi.edu grid-info-resource-register.conf grid-info-resource-ldif.conf GRIS Intro to Grid Computing and Globus Toolkit™
ExampleGRIS on dc-n2 registers with GIIS on dc-n1 • dn: Mds-Vo-Op-name=register, Mds-Vo-name=site, o=grid • regtype: mdsreg2 • reghn: dc-n1.isi.edu • regport: 2135 • regperiod: 600 • type: ldap • hn: dc-n2.isi.edu • port: 2135 • rootdn: Mds-Vo-name=local, o=grid • ttl: 1200 • timeout: 20 • mode: cachedump • cachettl: 30 dc-n2.isi.edu: $GLOBUS_LOCATION/etc/grid-info-resource-register.conf Intro to Grid Computing and Globus Toolkit™
New Information Providers • Decide what information to publish into MDS • Create a program that implements the IO interface requirements of a GRIS Information Provider • Enable the information provider for an MDS installation Intro to Grid Computing and Globus Toolkit™
New Information Providers • Decide what information to publish into MDS • OID: conflict avoidance • OID Registered with IANA Private Enterprise Numbers • http://www.iana.org/cgi-bin/enterprise.pl • 1.3.6.1.4.1.3536.* Globus OID subspace • 1.3.6.1.4.1.3536.2.* Globus Info Services OID subspace • 1.3.6.1.4.1.3536.2.6.* MDS OID subspace • ISI will delegate sub-trees of the Globus Info Srvcs OID space • mailto:mds-oid-registrar@globus.org • OR, register your own with IANA • Object Naming: conflict avoidance • ISI will coordinate prefix naming. Request a prefix from: • mailto:mds-oid-registrar@globus.org • Schema • Data Modeling problem • LDAP schema syntax problem • $GLOBUS_LOCATION/etc/grid-info-resource.schema Intro to Grid Computing and Globus Toolkit™
New Information Providers • Create your program • Any language. The only requirements are the I/O interface of your program: • Must be callable by fork and exec from the slapd process • You can pass in arguments to your program • Must return data in LDIF format • Data returned must match the LDAP schema • RFC 2849 Intro to Grid Computing and Globus Toolkit™
hostname hn= CPU RAM DISK CPU VM NET software= OS dev group= CPUs CPU CPU dev group= memory dev group= disk dev group= net RAM DISK NET dev= cpu 0 dev= cpu 1 CPU CPU VM dev= RAM dev= VM dev= /scratch1 dev= eth0 RAM VM DISK NET GRIS Host Objects OS OS Intro to Grid Computing and Globus Toolkit™
GRIS Structural Class Hierarchy Mds Attr: Mds-validfrom (like createtime) Attr: Mds-validto (accuracy metadata) Attr: Mds-keepto (discard metadata) MdsHost MdsDevice MdsDeviceGroup MdsSoftwareDeployment • Every MDS object: name, time metadata Intro to Grid Computing and Globus Toolkit™
Summary • The Grid problem: Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations • Grid architecture emphasizes systems problem • Protocols & services, to facilitate interoperability and shared infrastructure services • Globus Toolkit™: APIs, SDKs, and tools which implement Grid protocols & services • Provides basic software infrastructure for suite of tools addressing the programming problem Intro to Grid Computing and Globus Toolkit™