80 likes | 198 Views
Preparation for the TeraGrid:. Account Synchronization and High Performance Storage. Bobby House. About the TeraGrid. TeraGrid Integration. Integration Challenges Accounting Network Security TeraGrid Software Local Accounting System Interface Account Creation
E N D
Preparation for the TeraGrid: Account Synchronization and High Performance Storage Bobby House
TeraGrid Integration • Integration Challenges • Accounting • Network • Security • TeraGrid Software • Local Accounting System Interface • Account Creation • Tracking User Allocations
NCSA/TG Allocations User and project packets Frost (IBM BG/L) TGCDB FEN 1 Usage packets FEN 2 AMIE DBST Users and projects info Service Node ACC8 FEN 3 Job data FEN 4 tgactsync ReSET /etc/passwd /etc/project Users, Projects, DNs grid-mapfile usersync ReSET
High Performance Storage • Redeploying Bluesky storage • Special projects and extra storage for the TeraGrid • Redistributed 5 racks of storage for use with Frost • Re-Architected for performance and high availability • The FAStT storage system • Capacity: 32.85 TB Raw (~20TB Usable) • Performance: up to 1 GB/s • Design and Implementation • Full Hardware Redundancy • Full Software Redundancy with Linux multi-path and GPFS
A A A A A A A A A B B B B B B B B B A FC Switch A Frost FENs B FC Switch B
Continuing Work • MPI-IO testing and performance analysis: • GPFS on Frost storage subsystems (FAStT 500 and FAStT 900) • GPFS, Lustre, PVFS2 on dedicated storage system (Maelstrom) • Semi-Automated Performance Analysis • Benchmark Configuration • Data Collection • Plotting and Analysis • Incorporating these efforts into an upcoming paper on High Performance Storage