70 likes | 182 Views
TeraGrid Accounting System Progress and Plans. David Hart dhart@sdsc.edu July 26, 2007. Recent Accounting Activities. Server/Software Upgrade (Aug 2006) New hardware, PostgreSQL upgrade Test and development instances on prior hardware Ongoing monitoring
E N D
TeraGrid Accounting SystemProgress and Plans David Hartdhart@sdsc.edu July 26, 2007
Recent Accounting Activities • Server/Software Upgrade (Aug 2006) • New hardware, PostgreSQL upgrade • Test and development instances on prior hardware • Ongoing monitoring • NPU processing bottleneck eliminated (Dec 2006) • Troubleshooting, identifying and fixing issue • Solving Purdue Condor job backlog • Support for tracking arbitrary job “attributes” (Jan 2007) • Targeting proposed gateway needs • Project out-of-funds/expired packets, PI notification (March 2007) • Plus update to provide more info to RPs in RPI packets • Notification in use by NCSA, TG Cluster; Purdue planned • User inactivation (RAI packets) • Credits/debits via NPUs (May 2007) • Refunds, reservation charges, storage charges (in SUs), misc. credits/debits • TGCDB user “roles” (May 2007) • NPUs can flag user types including “community user”, “PI”, “co-PI”, “allocation manager.” • Other roles can be added. (Perhaps “training user”)
Activities currently underway • Job/NPU processing improvements • Simpler TGCDB structure, faster processing, easier error correction • Will also permit improved reporting capabilities • Ready, pending RP action • AMIE benchmarking • To identify bottlenecks and improve packet transport performance • Supporting ability for users to change contact information via portal • GRAM/grid job info • Already supported by TGCDB/AMIE, requires RP action
Ongoing Activities • DNs and DN propagation • TGCDB/AMIE components in place, troubleshooting TG-wide compliance • Portal support • Miscellaneous requests, including improvements to add user form, portal logins, etc. • Support for adding/decommissioning new resources, RPs • NCAR and Frost • Abe, Ranger, Big Ben, storage resources added • Lemieux, Radium, Tiger decommissioned • tgusage updates • Updated to v2.9 from v2.4 in August 2006 • Requested feature to extract per-job details • Ongoing support for trouble tickets, error correction • Including backloads of PSC data and PSC/SDSC DACs
Recent POPS Developments • Portal login support • Supporting grant data collection changes • to comply with NSF policy change • New resource types (storage, ASP) and billing units (TBs, Months) • Sept: Online proposal status tracking, viewing of reviewer comments • Enhanced admin capabilities to customize award notices and automate email notifices to PIs/co-PIs • Plans • Context-based help • Go “paperless” for reviewer meeting materials • DAC changes for NSF Graduate Fellows
Planned Activities • Storage usage accounting and reporting • Near-term updates • New features requested by other TG areas or to reflect policy changes • AMIE optimizations • Streamlining TGCDB procedures and triggers • New “Core Services” proposal submitted • To replace current NCSA/SDSC Core-leveraged funding for allocations and accounting-related activities • Better integration of and communication between POPS and Allocations activities/staff with TGCDB and Accounting activities/staff
TeraGrid Core Services 2.0 • Major focus for next year • Multi-site, GIG-funded team for requirements gathering and initial design • Top to bottom evaluation and integration of the allocation, authentication, authorization, and accounting system components • Seamless interaction between POPS, TGCDB, TGUP, Gateways infrastructure, and Authentication system • Eliminate NCSA Sybase from the critical path • Automate process to minimize the human effort required • Multi-site or site-independent project/user creation