TeraGrid National Cyberinfrasctructure for Scientific Research

1. TeraGridNational Cyberinfrasctructure for Scientific Research Kevin Shinpaugh

2. What is cyberinfrastructure? wireless sensors field computer computer network network data computer data data storage computer viz network fieldinstrument • A coordinated set of hardware, software, and services, all integrated and working together. • “CI” encompasses networks, computers, data, sensors, handheld devices, other technologies, and the services or human “glue” that holds them all together. The “computer” as an integrated set of resources

3. What is TeraGrid? • Supported by National Science Foundation • World’s largest distributed cyberinfrastructure for scientific research • Integrated high performance computers, data resources, experimental facilities provide coordinated, reliable performance. • Annual Science Highlights publication is good overview of projects supported by TeraGrid

4. 11 Resource Providers, One Facility Grid Infrastructure Group (UChicago) UW PSC UC/ANL NCAR PU NCSA UNC/RENCI IU Caltech ORNL NICS USC/ISI SDSC LONI TACC Resource Provider (RP) Software Integration Partner

5. TeraGrid Objectives • DEEP Science: Enabling Petascale Science • Make science more productive through integrated set of advanced computational resources • Address key challenges prioritized by users • WIDE Impact: Empowering Communities • Bring TeraGrid capabilities to the broad science community • Partnerships with community leaders, “Science Gateways” to make access easier • OPEN Infrastructure, OPEN Partnership • Provide a coordinated, general purpose, reliable set of services • Free and open to U.S. scientific research community and their international partners

6. TeraGrid Resources and Services • Computing -More than one petaflop of computing power today and growing • 579 Tflop Ranger system at Texas Advanced Computing Center (TACC) • 1030 TFlop Kraken (Cray Xt5) at National Institute for Computational Sciences (NICS), University of Tennessee • Remote visualization servers and software • 60 TFlop condor-based viz resource at Purdue University • Data • Allocation of data storage facilities • Over 100 Scientific Data Collections • Central allocations process • Technical Support • Central point of contact for support of all systems • Advanced Support for TeraGrid Applications (ASTA) • Education and training events and resources • Over 30 Science Gateways

7. TeraGrid User Community

8. TeraGrid Usage Modes in CY2008

9. How can I get started? • TeraGrid resources are free to NSF-supported academic researchers and educators • Education and Startup requests through TG Web site • up to 250,000 hours of time (depending on resource) • processed quickly (usually within 2 weeks) • Development Allocations Committee (DAC) for start-up accounts up to 30,000 hours of time are requests processed in two weeks - start-up and courses • Medium Resource Allocations Committee (MRAC) for requests of up to 500,000 hours of time are reviewed four times a year • Large Resource Allocations Committee (LRAC) for requests of over 500,000 hours of time are reviewed twice a year

10. Support for New and Established Users • TeraGrid Advanced Support for Applications (ASTA): Request help with code optimization, workflow improvement and gateways through • TeraGrid User Portal: Provides single location for information and help • Science Gateways: User access without allocation request, simplifies access to resources - contact the Gateway project • TeraGrid Pathways: New user support, mentoring, fellowships • Campus Champions: Individuals at your institution to offer support • HPC University: Online public resources • More details on support resources to follow…

11. TeraGrid Web Resources • TeraGrid User Portal for managing user allocations and job flow • Knowledge Base for quick answers to technical questions • User Information including documentation, information about hardware and software resources • Science Highlights • News and press releases • Education, outreach and training events and resources In general, seminars and workshops will be accessible via video on the Web. Extensive documentation will also be Web-based.

12. What is a Science Gateway? • A Science Gateway • Enables scientific communities of users with a common scientific goal • Uses high performance computing • Has a common interface • Leverages community investment • Three common forms: • Web-based portals • Application programs running on users' machines but accessing services in TeraGrid • Coordinated access points enabling users to move seamlessly between TeraGrid and other grids

13. How can a Gateway help? • Make science more productive • Researchers use same tools • Complex workflows • Common data formats • Data sharing • Bring TeraGrid capabilities to the broad science community • Lots of disk space • Lots of compute resources • Powerful analysis capabilities • A nice interface to information

14. Gateway HighlightNanoHub Harnesses TeraGrid for Education • Nanotechnology education • Used in dozens of courses at many universities • Teaching materials • Collaboration space • Research seminars • Modeling tools • Access to cutting edge research software

15. Gateways HighlightSCEC Produces Hazard Map • PSHA hazard map for California using newly released Earthquake Rupture Forecast (UCERF2.0) calculated using SCEC Science Gateway • Warm colors indicate regions with a high probability of experiencing strong ground motion in the next 50 years. • High resolution map, significant CPU use

16. How can I build a gateway? • Web information available: www.teragrid.org/programs/sci_gateways • How to turn your project into a science gateway • Details about current gateways • Link to write a winning gateway proposal for a TeraGrid allocation • Download code and instructions • Building a simple gateway tutorial • Talk to us • Biweekly telecons to get advice from others • Potential assistance from TeraGrid staff • Nancy Wilkins-Diehr, wilkinsn@sdsc.edu • Vickie Lynch, lynchve@ornl.gov

17. TeraGrid Annual Conference • Showcases capabilities, achievements and impact of TeraGrid in research • Presentations, demos, posters, visualizations • Tutorials, training and peer support • Student competitions and volunteer opportunities • Held in June of each year – August this year

18. TeraGrid Pathways Program • Program to engage new TeraGrid users from traditionally underserved groups including women and minorities • Funded by special NSF supplementary award • Pathways program includes: -New User Support for allocation requests and startup support -Mentoring for community and discipline research dissemination -Fellowships to allow new users “immersion” opportunities -Science Gateways -Evaluation Tools, including matrices and case studies

19. Pathways Fellowships The Pathways Fellowship Program will provide: • Faculty: summer salary (or) release time from teaching for up to one semester • Students: research salary (and/or) student support for up to one semester • Support for visits to TeraGrid Resource Provider (RP) sites • Opportunities for inter‐disciplinary collaboration with other TeraGrid researchers • In‐depth consulting and support • Up to 30,000 service units (CPU hours) on TeraGrid resources as well as support for larger allocation requests

20. Pathways Fellowships • Responsibilities of Pathways Fellows: • Participation in a colloquium of other fellows to discuss experiences, challenges, and successes • Participation in the Annual TeraGrid Conference in the form of paper or contest entries • Continued post‐program involvement with current fellows • http://teragrid.org/eot “Pathways” pathways@teragrid.org

21. Campus Champions Program • Source of local, regional and national high performance computing and cyberinfrastructure information at home campus • Source of information about TeraGrid resources and services that will benefit their campus • Source of startup accounts to quickly get researchers and educators using their allocation of time on the TeraGrid resources • Direct access to TeraGrid staff • http://www.teragrid.org/eot/campuschamps.html

22. TeraGrid HPC Education and Training • Workshops, institutes and seminars on high-performance scientific computing • Hands-on tutorials on porting and optimizing code for the TeraGrid systems • On-line self-paced tutorials • High-impact educational and visual materials suitable for K–12, undergraduate and graduate classes

23. HPC University • Virtual Organization to advance researchers’ HPC skills • Catalog of live and self-paced training • Schedule series of training courses • Gap analysis of materials to drive development • Work with educators to enhance the curriculum • Search catalog of HPC resources • Schedule workshops for curricular development • Leverage good work of others • Offer Student Research Experiences • Enroll in HPC internship opportunities • Offer Student Competitions • Publish Science and Education Impact • Promote via TeraGrid Science Highlights, iSGTW • Publish education resources to NSDL-CSERD http://hpcuniv.org/

24. Sampling of Training Topics Offered • HPC Computing • Introduction to Parallel Computing • Toward MulticorePetascale Applications • Scaling Workshop - Scaling to Petaflops • Effective Use of Multi-core Technology • TeraGrid - Wide BlueGene Applications • Domain-specific Sessions • Petascale Computing in the Biosciences • Visualization • Introduction to Scientific Visualization • Remote/Collaborative TeraScale Visualization on the TeraGrid • Other Topics • Rocks Linux Cluster Workshop • LCI International Conference on HPC Clustered Computing • Over 30 on-line asynchronous tutorials

25. SC Education Program • Multi-year, year-long, Education Programs to provide continuity and sustained impact • Integrate HPC into high school and undergraduate science, technology, engineering and mathematics classrooms • Foster High School - College partnerships • Significantly expanded digital libraries of resources for teaching and learning - CSERD/NSDL, ACM Digital Library • Sponsors: ACM, IEEE, TeraGrid, NCSI, CSERD, Krell, and NSF • Recruiting faculty and institutions to innovate their curriculum

26. Broaden Awareness through CI Days • Work with campuses to develop leadership in promoting CI to accelerate scientific discovery • Catalyze campus-wide and regional discussions and planning • Collaboration of Open Science Grid, Internet 2, National Lamda Rail, EDUCAUSE, Minority Serving Institution Cyberinfrastructure Empowerment Coalition, TeraGrid, and local & regional organizations • Identify Campus Champions http://cidays.org

27. For More Information www.teragrid.org www.computationalscience.org www.nsdl.org cserd.nsdl.org www.nsf.gov/oci/ http://cidays.org help@teragrid.org

28. Questions?