1 / 10

Monitoring and Information Services Architecture and Deployment

University at Buffalo. The State University of New York. Monitoring and Information Services Architecture and Deployment. Mark L. Green, Ph.D. Grid Computational Scientist. Layout. Monitoring and information Services - Core Infrastructure (MIS-CI) MIS Compute Element and Storage Element

hope-meyers
Download Presentation

Monitoring and Information Services Architecture and Deployment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. University at Buffalo The State University of New York Monitoring and Information Services Architecture and Deployment Mark L. Green, Ph.D. Grid Computational Scientist

  2. Layout • Monitoring and information Services - Core Infrastructure (MIS-CI) • MIS Compute Element and Storage Element • Discovery Service • Consumer Interface • Resource Repository • Information Gathering • Current Grid3 Monitoring Services • MIS-CI Deployment • MIS-CI Proof of Concept Timeline

  3. MIS-CI • MIS Compute Element and Storage Element Discovery Service • Lightweight information gathering • Self monitoring • Scalable • Expandable • Robust and Fault Tolerant • Timestamps • API

  4. MIS-CI • MIS Compute Element and Storage Element Consumer Interface • Modular and customizable query infrastructure • Self monitoring • Scalable • Consumer profiles • Consumer throttling • API

  5. MIS-CI • MIS Compute Element and Storage Element Resource Repository • Lightweight with minimal resource loading and requirements • Self monitoring • Expandable • Common schema with unique name space • Virtual organization based aggregation • Timestamps

  6. MIS-CI • MIS Compute Element and Storage Element Information Gathering • Lightweight information gathering • Self monitoring • Expandable • Modular design • Cron based implementation

  7. Current Grid3 Monitoring Services • Unfortunately these projects have significant overlap and often report an inconsistent representation of the core monitoring and information required by application managers and grid schedulers. • The current monitoring systems include: • MonaLisa, GridCat, MDS, ACDC Job Monitoring, Ganglia • Representatives from each project have agreed to participate in the Monitoring and Information Services Technical Group and contribute information gathering infrastructure, expertise, and compatibility infrastructure.

  8. SQL-Lite Local Historical Repository SQL-Lite Remote VO Historical Repository Cron jobs gridftp diskspace accounting Self- Monitor policy environment software VO statistics security ? MIS-CI Architecture MIS-CI Resource Throttling Discovery Service User Schema Eval Resource Gatekeeper • jobmanager-mis • -profile (default) • jobs • gridftp • diskspace • -accounting • policy • environment • software • VO • statistics • security SQL-Lite Database MIS-CI Consumer Throttling SQL-Lite Database Backup MIS-CI Profiles Custom Remote Repository Grid Scheduler OSG Auditing/Accounting

  9. MIS-CI Deployment • Proof of Concept MIS-CI Deployment • Pacman Cache • Grid3Dev • Mama Cluster • Grid3 • Acdc Cluster • Document Management System • Module management • Version control • MIS-CI API • MIS-CI Online Documentation

  10. MIS-CI Deployment Timeline • Proof of Concept MIS-CI Deployment ~ 12/2004 • Pacman Cache • Grid3Dev ~ 1/2005 • Mama Cluster • Grid3 ~ 2/2005 • ACDC Cluster • Document Management System ~ 12/2004 • Module management • Version control • MIS-CI API ~ 1/2005 • MIS-CI Online Documentation ~ 1/2005 • Proof of Concept Web Repository (ACDC) ~ 1/2005 • Only use MIS-CI for Information Gathering • Load/Usage Statistics and Scalability reporting

More Related