250 likes | 401 Views
Report on CSU HPC (High-Performance Computing) Study Ricky Yu–Kwong Kwok Co-Chair, Research Advisory Committee ISTeC Ricky.Kwok@colostate.edu August 18, 2008 Presented to CSU CRAD. Outline. Motivation for the Study Interpretations of Findings Summary of Findings Representative HPC Activities
E N D
Report on CSU HPC (High-Performance Computing) StudyRicky Yu–Kwong KwokCo-Chair, Research Advisory CommitteeISTeCRicky.Kwok@colostate.eduAugust 18, 2008Presented to CSU CRAD
Outline • Motivation for the Study • Interpretations of Findings • Summary of Findings • Representative HPC Activities • CoGrid Job Submission System • HPC Forum (9/3/2008)
Motivation for the Study • HPC is a 3rd way of conducting research and discovery • To assess current activities and future opportunities • To look at current systems at CSU • To make CSU more competitive in the research arena Study Motivation
Interpretations of Findings • 37 responses 26 departments, 31 research areas • HPC is “hot” at CSU! • 1/3 of users have no immediate access to HPC resources rely on other departments within CSUOR other organizations outside CSU may be subject to strict resource restrictions Interpretations of Findings
Interpretations of Findings • Scattered resources • Majority of users pessimistic about their HPC needs being met in future • Advanced visualization needs require enhancement • Need to “advertise” GRAD 510/511 courses • Space limitations for HPC hardware??? • Consultancy? • Affinity groups? Interpretations of Findings
Summary of Findings • 37 responses 26 departments, 31 research areas • Besides CoGrid node, Bioinformatics cluster and HP Half Dome system, 8 additional HPC resources, e.g., (see Table 2 in the Report) • CIRA – 32-processor cluster • Chemical and Biological Engineering – 32-node Linux cluster • Mathematics – 42-node cluster • Some more new resources to come (e.g., new HP donations) Summary of Findings
Usage of HPC Summary of Findings
Nature of Usage Summary of Findings
Algorithms Used Summary of Findings
HPC Resource Used Summary of Findings
HPC Needs Met? Current Future Summary of Findings
Visualization Needs Met? Current Future Summary of Findings
Compiler Used Summary of Findings
Language Used Summary of Findings
Be Involved in Future HPC Activities? Summary of Findings
Aware of GRAD 510/511? Summary of Findings
Required Follow-Up? Summary of Findings
Presentation Outline • Motivation of the Study • Interpretations of Findings • Summary of Findings • Representative HPC Activities • CoGrid Job Submission System • HPC Forum
Small-angle X-ray Scattering (SAXS) • To understand biological systems • Determine 3-D structure • Monte Carlo simulations for data modeling • Computationally intensive HPC Representative HPC Activities
Genomic Analysis • Study the evolution of functional DNA sequences • Comparative phylogenomic analysis • Highly computationally intensive cluster of Linux machines with 8 – 32 nodes Representative HPC Activities
Proteomics • Large-scale study of proteins • Searching methods to analyze mass spectrometry data • Sequence matching • Access to large databases Representative HPC Activities
Pattern Analysis • Investigate unexplained phenomena from high-dimensional, massive data sets • Mathematical theory efficient algorithms exploring, understanding, modeling massive data sets • PAL lab (Pattern Analysis Laboratory) 42-node cluster with 156 GB total memory, over 5 TB disk storage Representative HPC Activities
CoGrid Job Submission System • Sharing of geographically distributed computational resources • Batch processing of jobs • Job description • Resource requirements • Execution • Monitoring CoGrid
HPC Forum (9/3/2008) • Introduction and ISTeC Overview: HJ • Background on CSU’s HPC History and Activities: Pat Burns • Findings from ISTeC’s HPC Survey: Ricky • Advanced Networking Capabilities at CSU: Scott Baily, Director of ACNS • Educational Activities in HPC: Sanjay Rajopadhye and Wim Bohm (Computer Science) • Plan for an ISTeC Visualization Facility: HJ • NERSC and the INCITE Program as a Viable Alternative: Josh Ladd (Mathematics) • Open Discussion – Faculty Needs and Directions
Summary • Motivation: To look at current systems in CSU and future HPC needs • Presented interpretations and findings of the survey • Discussed representative HPC activities • Introduced CoGrid job submission system, as a possible campus-wide resource management model • HPC Forum for further discussions