1 / 13

State of TeraGrid

State of TeraGrid. John Towns Co-Chair, TeraGrid Forum Director, Persistent Infrastructure National Center for Supercomputing Applications University of Illinois. Our Vision of TeraGrid.

mordecai
Download Presentation

State of TeraGrid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. State of TeraGrid John Towns Co-Chair, TeraGrid Forum Director, Persistent Infrastructure National Center for Supercomputing Applications University of Illinois TG ’08, June 9-13, 2008

  2. Our Vision of TeraGrid • A large-scale operational cyberinfrastructure that provides very high-end computational capabilities for leading-edge research in the national open science community, while also reaching out to new users and communities to broaden the impact of cyberinfrastructure in research, education, and society • A complex collaboration of over a dozen organizations and NSF awards working together to provide collective services that go beyond what can be provided by individual institutions More than just the sum of its parts TeraGrid ‘08, June 9-13, 2008

  3. TeraGrid: greater than the sum of its parts… • Single unified allocations process • Single point of contact for problem reporting • Simplified access to high end resources for science and engineering • coordinated software environments • uniform access to heterogeneous resources to solve a single scientific problem • Expertise in building national computing and data resources • Leveraging extensive resources, expertise, R&D, and EOT • leveraging other activities at participant sites • learning from each other improves expertise of all TG staff • Leadership in cyberinfrastructure development, deployment and support • demonstrating enablement of science not possible without the TeraGrid-coordinated human and technological resources TeraGrid ‘08, June 9-13, 2008

  4. TeraGrid Participants TeraGrid ‘08, June 9-13, 2008

  5. Allocations Process • National peer-review process • allocates computational and data resources • makes recommendations on allocation of advanced direct support services • Managed by TeraGrid • GIG and RP Participants in reviews • CORE Services award to manage shared responsibilities • TACC: Meeting coordination • SDSC: TG Central DB • NCSA: POPS, TG Allocations group • Currently awarding >1B Normalized Units of resources TeraGrid ‘08, June 9-13, 2008

  6. TeraGrid Annual Review • Panel Review held April 15-17, 2008 • High-Level Findings • Things are going well… • “The overall assessment of the panel is that the TeraGrid is doing an excellent job.” • “The TeraGrid is among the best grids in the world with respect to providing resources to a broad and inclusive audience. ” • Over the next year, the TeraGrid should • formulate a strategic plan • address the problem of petascale data analysis • seize the opportunity presented by Science Gateways • formulate a definite plan to provide a global parallel file system • continue to strive for better integration of management processes • assess major risks and maintain a risk mitigation plan • provide clearer milestones in future annual reports. TeraGrid Annual Review, April 15-16, 2008

  7. TeraGrid Continues to Move Forward • Growing user base and delivered usage • increasing diversity in disciplines the user community spans! • Growing resources and capabilities • new awards and awardees • Track 2a: Ranger @ TACC • Track 2b: Kraken @ UTK/NICS • compute, data, visualization… • human! TeraGrid ‘08, June 9-13, 2008

  8. HPC User Community is Growing TeraGrid ‘08, June 9-13, 2008 Source: TeraGrid Central Database

  9. Usage is also Growing.... 3.95B NUs delivered in CY2007 TeraGrid ‘08, June 9-13, 2008 Source: TeraGrid Central Database

  10. CY2007 Usage by Discipline Advanced Scientific All 19 Others Atmospheric Computing 4% Sciences 2% 3% Earth Sciences 3% Molecular Chemical, Thermal Biosciences Systems 31% 5% Materials Research 6% Astronomical Sciences 12% Chemistry 17% Physics 17% 3.95B NUs delivered in CY2007 TeraGrid ‘08, June 9-13, 2008

  11. Clusters: ~475TF Purdue: 120TF Steele: DELL EM64T, 60TF Condor Pool: 60TF NCSA: 116TF Abe: Dell PE1950 Blades, 90TF Tungsten: Dell PE1750, 16TF Mercury: IBM IA-64, 10TF TACC: 62TF Lonestar: PE1955, 62TF LONI: 51TF Queen Bee: Dell PE1950 Blades, 51TF Indiana: 7TF Quarry: IBM HS21, 7TF SDSC: 3.1TF TG Cluster: IBM IA-64, 3.1TF ANL: 0.61TF TG Cluster: IBM IA-64, 0.61 TF ORNL: 0.34TF NSTG: IBM IA-32, 0.34TF MPPs: ~765TF TACC: 504TF Ranger: Sun Constellation, 504TF UTK/NICS: 170TF Kraken: Cray XT4, 170TF SDSC: 31.5TF BlueGene: IBM BlueGene/L, 17.2TF DataStar: IBM p655, 14.3TF Indiana: 30.7TF Big Red: IBM JS21, 30.7TF PSC: 21.3TF Big Ben: Cray XT3, 21.5 TF NCAR: 5.7TF Frost: IBM BlueGene/L, 5.7TF SMPs: ~12.9TF NCSA: 6.6TF Cobalt: SGI Altix, 6.6TF PSC: 5TF Pople: SGI Altix, 5 TF SDSC: 1.3TF DataStar: IBM p690s, 1.3TF TG Compute Resources: ~1.2PF TeraGrid ‘08, June 9-13, 2008

  12. TG Data and Vis Resources • Data Resources • Data Collections, Database and Local Disk Space • SDSC: 400TB • NCSA: 220TB (Projects Filesystems) • Indiana: 100TB • Remote/Wide Area Disk Space • Indiana: 535TB (Data Capacitor) • SDSC: 150TB (GPFS-WAN) • Visualization Resources • TACC: • Maverick • Sun E25K, NvidiaQuadro FX 3000G (32) • serial and parallel, remote visualization applications • ANL: • IA-32 Viz Cluster • IBM IA-32, NvidiaGeFORCE 6600GT (96) • Purdue: • TeraDRE • Condor Pools, NvidiaGeForce 6600 GT (48) • graphics rendering • Indiana • IU Render Portal • Windows Condor pool w/ Maya and Blender • educational emphasis TeraGrid ‘08, June 9-13, 2008

  13. Looking Forward: plenty of challenges and opportunities • Integrating new resources • Track 2c: [[TBA]] • Track 2d: ??? (and see below) • Project planning • develop a much better integrated project plan spanning GIG and RP activities • Strategic Planning • advised by both SAB and review committee to develop longer term vision and strategic plan • Funding opportunities (stealing Steve’s thunder) • “TeraGrid III” solicitation • defining the next generation of infrastructure for high end digital resources • Track 2d updated solicitation • new opportunities for diversifying resources TeraGrid ‘08, June 9-13, 2008

More Related