1 / 21

NPACI HotPage Updates

NPACI HotPage Updates. Kurt Mueller San Diego Supercomputer Center kurt@sdsc.edu. NPACI. National Partnership for Advanced Computational Infrastructure. US National Science Foundation funded collaboration between research institutions:

stephen-stephens
Download Presentation

NPACI HotPage Updates

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NPACI HotPage Updates • Kurt Mueller • San Diego Supercomputer Center • kurt@sdsc.edu

  2. NPACI National Partnership for Advanced Computational Infrastructure • US National Science Foundation funded collaboration between research institutions: • San Diego Supercomputer Center (SDSC) - University of California, San Diego • Texas Advanced Computing Center (TACC) - University of Texas, Austin • Center for Advanced Computing (CAC) - University of Michigan • 46 other institutions...

  3. NPACI resources • compute • SDSC Blue Horizon - 1152 CPU IBM SP • TACC Longhorn - 224 CPU IBM Power4 • TACC Aurora - 16 CPU Cray SV1 • CAC Morpheus, Hypnos - 256, 134 CPU AMD clusters • CAC 64 and 24 CPU IBM SP systems

  4. NPACI resources • storage • SDSC HPSS - 6 petabytes • TACC DMF - 1.4 petabytes • CAC ADSM - 41 terabytes • Caltech HPSS - 323 terabytes

  5. aggregate resources • 463 nodes • 1854 CPUs • 4345 peak GFlops • 1714 GB RAM • 7.7 petabytes tape storage

  6. status bar

  7. individual resource info

  8. login for more tools

  9. architecture

  10. HotPage updates • moved to Apache on linux • underlying GridPort updated to 2.3 • object-oriented perl • module packaging • simplified installation • new features: NWS, etc.

  11. data collection • old methods of data collection: • cron jobs on webserver, triggering ssh commands to execute remote scripts on resources and store data on webserver • Globus job run to execute remote scripts • GIS queries for status data

  12. data collection • problems with old methods: • some scripts generated LDIF, some HTML • no separation of content and presentation • GIS support inconsistent across partner sites • no persistent storage of data - historical record

  13. GP-IR data repository • GridPort Information Repository • developed at TACC, with help from SDSC • XML-centric database to store performance and other data • web services data ingester and query interface

  14. GP-IR data example • <?xml version="1.0" encoding="UTF-8" ?> <loadInfo xmlns="http://grids.tacc.utexas.edu/schemas/infoservices/load" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://grids.tacc.utexas.edu/schemas/infoservices/load/load.xsd" timestamp="2001-12-17T09:30:47-05:00" hostname="horizon.sdsc.edu"> • <load> • <type>queue</type> <Percent>87</Percent> • </load> • </loadInfo>

  15. GP-IR data caching • cron jobs run on HotPage server to query GP-IR every five minutes and write out xml to cache directories • HotPage page requests generate live queries to GP-IR • if live queries fail, HotPage scripts load cached XML

  16. resource view sorting

  17. grid view • summary table • grid monitor • NWS

  18. to do • historical performance queries • portlets - presentation this week • customization, portability • GridPort 3.0 - ditto • OGSA • HotPage source code distribution - this week? • rollout technologies to PACI HotPage • NPACI, NCSA and PSC resources

  19. links • https://hotpage.npaci.edu/ • http://www.npaci.edu • http://www.sdsc.edu • http://www.tacc.utexas.edu • GridPort http://gridport.npaci.edu • GP-IR http://www.tacc.utexas.edu/grid/gpir/

More Related