1 / 19

Information Services

Information Services. Andrew Brown Jon Ludwig Elvis Montero Modified By Xi He. Overview. WSRF Monitoring and Discovery System in Globus Ganglia. WSRF. Message Patterns for Define properties Request the value of a property or properties Alter the value of a property or properties

caesar-owen
Download Presentation

Information Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Information Services Andrew Brown Jon Ludwig Elvis Montero Modified By Xi He

  2. Overview • WSRF • Monitoring and Discovery System in Globus • Ganglia

  3. WSRF Message Patterns for • Define properties • Request the value of a property or properties • Alter the value of a property or properties So that we can • Create state objects • Get properties in state objects • Set properties in state objects • Destroy state objects

  4. WSRF(CONT.) WSRF defines its message patterns by defining WSDL file WSRF Include identifier to specify resource example.wsdl example0.wsdl example1.wsdl A useful tutorial https://www6.software.ibm.com/developerworks/education/gr-wsrf1/index.html

  5. MDS - Overview [Globus01]

  6. MDS – Aggregator and Information Source Framework Information sources for which discovery or access is required are explicitly registered with an aggregator service. Registrations have a lifetime: if not renewed periodically, they expire.

  7. MDS – Aggregator and Information source (CONT.) The aggregator periodically collects up-to-date state or status information from all registered information sources, by using an information-source-specific access mechanism. The aggregator then makes all information obtained from registered information sources available via an aggregator-specific Web services interface.

  8. MDS - Basic Components • Index Service • Collects information • Stores as resource properties • Supports queries and subscriptions • Indices can be linked together • Trigger Service • Collects information • Matches rules and fires actions • WebMDS • View information in web browser • Used by end users

  9. MDS – Example The monitoring system for The Earth System Grid (ESG) The Earth System Grid (ESG) provides climate studies scientists with access to large datasets that are important for their work The ESG infrastructure is a distributed system made up of physical devices and software services The ESG team needed a way to monitor the status of their system components in order to detect and notify interested parties of failures http://www.globus.org/solutions/system_monitoring/

  10. MDS – Example (CONT.) http://www.globus.org/solutions/system_monitoring/

  11. Ganglia • Real-time monitoring and execution environment for cluster • Not only links nodes in a cluster, but also links clusters to other clusters • Remotely view live or historical statistical data • High performance • Low overhead per node • High concurrence • Scalable

  12. Ganglia Monitor Daemon - gmond • Multithreaded daemon • Runs on each node that you wish to monitor • Minimal footprint - In-memory hashtable • Responsibilities: • Monitor change in host state • Listens to the state of other Ganglia nodes • Multicast relevant changes • answer requests for an XML description of the cluster state

  13. Ganglia Monitor Daemon - gmond [GDT2002]

  14. Ganglia Meta Daemon - gmetad

  15. Ganglia Web Frontend • Collects the tree of data from gmetad and displays it to the user via a website • Demo • http://monitor.millennium.berkeley.edu/ • http://cluster.rit.edu/ganglia/ • Periodically polls child data sources to gather information about cluster states • Saves data in a database • Collect data from individual nodes or from clusters

  16. Ganglia Architecture

  17. References [Globus01] GT 4.0: Information Services.  http://www.globus.org/toolkit/docs/4.0/info/. [OASIS] OASIS Web Services Resource Framework (WSRF) TC.  http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wsrf. [Globus02] WSRF: The Web Services Resource Framework.  http://gdp.globus.org/gt4-tutorial/multiplehtml/ch01s03.html. [Atkinson] Atkinson, Malcolm et al.  Web Service Grids: An Evolutionary Approach.  http://www.omii.ac.uk/dissemination/paper_web_service_grids.pdf. [Wikipedia01] Web Services Resource Framework.  http://en.wikipedia.org/wiki/Web_Services_Resource_Framework.

  18. References cont. [Foster] Foster, Ian.  A Globus Primer.  http://www.globus.org/toolkit/docs/4.0/key/GT4_Primer_0.6.pdf. [Globus03] Deploying WS MDS in a Virtual Organization. http://www.globus.org/toolkit/docs/4.0/info/key/deployment_overview.html. [Globus04] GT 4.0 WS MDS WebMDS: System Administrator’s Guide. http://www.globus.org/toolkit/docs/4.0/info/webmds/admin-index.html. [Globus05] GT 4.0 WS MDS Trigger Service: System Administrator’s Guide. http://www.globus.org/toolkit/docs/4.0/info/trigger/admin-index.html. [Wikipedia02] Ganglia (software). http://en.wikipedia.org/wiki/Ganglia_%28software%29.

  19. References cont. [GDT2002] Ganglia Toolkit. http://www.msg.ucsf.edu/local/ganglia/ganglia_docs/index.html [Massie2004Ganglia] "The Ganglia Distributed Monitoring System: Design, Implementation, and Experience". Matthew L. Massie, Brent N. Chun, and David E. Culler. Parallel Computing, Vol. 30, Issue 7, July 2004. [ESG] The Earth System Grid (ESG) monitoring architecture. http://www.globus.org/solutions/system_monitoring/architecture.php. [MonaLISA] MonaLISA's Architecture.  http://monalisa.cacr.caltech.edu/monalisa_e__System_Design.htm. [Inca] Inca's architecture and screenshots. http://inca.sdsc.edu/drupal/node/20. [IBM] WebMDS Screen Shot. http://www.ibm.com/developerworks/cn/grid/gr-gt4mds/webMDSRFT.jpg

More Related