1 / 15

Grid Information Services

Explore the functionality of MDS-2 service architecture within the Globus Project, including resource registration, dynamic registration protocols, and resource discovery methods. Learn about GRIS providers, LDAP integration, and how to configure information providers.

barbarareed
Download Presentation

Grid Information Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Grid Information Services The Globus Project Argonne National LaboratoryUSC Information Sciences Instutute http://www.globus.org/

  2. MDS-2 Service Architecture VO-specific Aggregate Directories discovery (GRIP?) ? A A lookup (GRIP) registration (GRRP) R R R R standard Resource Description services • Dynamic Registration via Reg. Protocol (GRRP) • Resource Inquiry via Info. Protocol (GRIP) • Co-located with resource on network • Resource Discovery (via GRIP or other) • Using GRIP allows resource/directory hierarchy Intro to Grid Computing and Globus Toolkit™

  3. Soft-state Registration • Periodic notification • “Service/resource is available” • Expected-frequency metadata • Automatic directory construction • Add new resources to directory • Invite resources to join new directory • Self-cleaning • Reduce occurrence of “dead” references Intro to Grid Computing and Globus Toolkit™

  4. MDS-2 Implementation • Grid Information Service (GRIS) • Provides resource description • Modular content gateway • Grid Index Information Service (GIIS) • Provides aggregate directory • Hierarchical groups of resources • Lightweight Dir. Access Protocol (LDAP) • Standard with many client implementations • Used for GRIP (and GRRP currently) Intro to Grid Computing and Globus Toolkit™

  5. MDS-2.1 External Software Stack • OpenLDAP 2.0.x (.14) • Implements LDAPv3 protocol • Client and server components • Cyrus-SASL • Generic security • We provide loadable SASL/GSS plugin • Globus GSI • Provides GSS-API interface to PKI • Shared library used by our SASL plugin Intro to Grid Computing and Globus Toolkit™

  6. MDS-2.1 Internal Software • Wrappers/tools • Simplify typical idioms • Feature-specific GRIS providers • Resource-specific information probes • Modular interface to GRIS • LDAP server “backend” modules • GRIS provider dispatch/caching • GIIS implementation • SASL/GSS plugin Intro to Grid Computing and Globus Toolkit™

  7. MDS-2.1 GRIS Providers • grid-info-cpu reports CPU/load info • grid-info-fs reports filesystem info • grid-info-mem reports RAM/VM info • grid-info-net reports NIC/net info • grid-info-os reports OS info • grid-info-platform reports arch. info • grid-info-merged merges all host info* • Extensible for other sources, e.g. GRAM Intro to Grid Computing and Globus Toolkit™

  8. Configuration files for Registration dc-n1.isi.edu grid-info-site-policy.conf grid-info-resource-register.conf grid-info-resource-ldif.conf GIIS GRIS dc-n2.isi.edu grid-info-resource-register.conf grid-info-resource-ldif.conf GRIS Intro to Grid Computing and Globus Toolkit™

  9. ExampleGRIS on dc-n2 registers with GIIS on dc-n1 • dn: Mds-Vo-Op-name=register, Mds-Vo-name=site, o=grid • regtype: mdsreg2 • reghn: dc-n1.isi.edu • regport: 2135 • regperiod: 600 • type: ldap • hn: dc-n2.isi.edu • port: 2135 • rootdn: Mds-Vo-name=local, o=grid • ttl: 1200 • timeout: 20 • mode: cachedump • cachettl: 30 dc-n2.isi.edu: $GLOBUS_LOCATION/etc/grid-info-resource-register.conf Intro to Grid Computing and Globus Toolkit™

  10. New Information Providers • Decide what information to publish into MDS • Create a program that implements the IO interface requirements of a GRIS Information Provider • Enable the information provider for an MDS installation Intro to Grid Computing and Globus Toolkit™

  11. New Information Providers • Decide what information to publish into MDS • OID: conflict avoidance • OID Registered with IANA Private Enterprise Numbers • http://www.iana.org/cgi-bin/enterprise.pl • 1.3.6.1.4.1.3536.* Globus OID subspace • 1.3.6.1.4.1.3536.2.* Globus Info Services OID subspace • 1.3.6.1.4.1.3536.2.6.* MDS OID subspace • ISI will delegate sub-trees of the Globus Info Srvcs OID space • mailto:mds-oid-registrar@globus.org • OR, register your own with IANA • Object Naming: conflict avoidance • ISI will coordinate prefix naming. Request a prefix from: • mailto:mds-oid-registrar@globus.org • Schema • Data Modeling problem • LDAP schema syntax problem • $GLOBUS_LOCATION/etc/grid-info-resource.schema Intro to Grid Computing and Globus Toolkit™

  12. New Information Providers • Create your program • Any language. The only requirements are the I/O interface of your program: • Must be callable by fork and exec from the slapd process • You can pass in arguments to your program • Must return data in LDIF format • Data returned must match the LDAP schema • RFC 2849 Intro to Grid Computing and Globus Toolkit™

  13. hostname hn= CPU RAM DISK CPU VM NET software= OS dev group= CPUs CPU CPU dev group= memory dev group= disk dev group= net RAM DISK NET dev= cpu 0 dev= cpu 1 CPU CPU VM dev= RAM dev= VM dev= /scratch1 dev= eth0 RAM VM DISK NET GRIS Host Objects OS OS Intro to Grid Computing and Globus Toolkit™

  14. GRIS Structural Class Hierarchy Mds Attr: Mds-validfrom (like createtime) Attr: Mds-validto (accuracy metadata) Attr: Mds-keepto (discard metadata) MdsHost MdsDevice MdsDeviceGroup MdsSoftwareDeployment • Every MDS object: name, time metadata Intro to Grid Computing and Globus Toolkit™

  15. Summary • The Grid problem: Resource sharing & coordinated problem solving in dynamic, multi-institutional virtual organizations • Grid architecture emphasizes systems problem • Protocols & services, to facilitate interoperability and shared infrastructure services • Globus Toolkit™: APIs, SDKs, and tools which implement Grid protocols & services • Provides basic software infrastructure for suite of tools addressing the programming problem Intro to Grid Computing and Globus Toolkit™

More Related