Developing TeraGrid Campus Partnerships

1. Developing TeraGrid Campus Partnerships An Initial Collaboration between TeraGrid, Internet2, and Open Science Grid Fall Internet2 Member Meeting Gary Bertoline, Assistant Dean forGraduate Studies and Professor – Computer Graphics, Purdue University Scott Lathrop, Education, Outreach & Training/External Relation TeraGrid, University of Chicago and Argonne National Labs Charlie Catlett, TeraGrid Director, University of Chicago and Argonne National Labs MANY Others

2. TeraGrid Mission • TeraGrid provides integrated, persistent, and pioneering computational resources that will significantly improve our nation’s ability and capacity to gain new insights into our most challenging research questions and societal problems. • Our vision requires an integrated approach to the scientific workflow including obtaining access, application development and execution, data analysis, collaboration and data management. • These capabilities must be accessible broadly to the science, engineering, and education community.

3. TeraGrid A National Production CI Facility Phase I: 2001-2004 Design, Deploy, Expand Phase II: 2005-2010 Operation & Enhancement UW PSC UC/ANL PU NCSA IU NCAR Caltech UNC USC/ISI ORNL SDSC TACC 20+ Distinct Computing Resources (>150TF today; ~600TF by 8/2007) 100+ Data Collections Resource Provider Software Partner

4. TeraGrid Objectives • DEEP Science: Enabling Petascale Science • Make Science More Productive through an integrated set of very-high capability resources • Address key challenges prioritized by users • WIDE Impact: Empowering Communities • Bring TeraGrid capabilities to the broad science community • Partner with science community leaders - “Science Gateways” • OPEN Infrastructure, OPEN Partnership • Provide a coordinated, general purpose, reliable set of services and resources • Partner with campuses and facilities

5. TeraGrid Projects by Institution 1000 projects, 3200 users Blue: 10 or more PI’s Red: 5-9 PI’s Yellow: 2-4 PI’s Green: 1 PI

6. Open Science Grid (OSG) • The Open Science Grid is a distributed computing infrastructure for large-scale scientific research, built and operated by a consortium of universities, national laboratories, scientific collaborations and software developers. • The OSG Consortium's unique community alliance brings petascale computing and storage resources into a uniform grid computing environment. • Members of the OSG Consortium contribute effort and resources and reap the benefits of a shared infrastructure that integrates computing and storageresources from more than 50 sites in the United States, Asia and South America.

7. OSG Sites

8. Internet2 • Internet2 is an advanced networking consortium led by the research and education community since 1996. • Internet2 promotes the missions of its members by providing both leading-edge network capabilities and unique partnership opportunities that together facilitate the development, deployment and use of revolutionary Internet technologies. • By bringing research and academia together with technology leaders from industry, government and the international community, Internet2 promotes collaboration and innovation that has a fundamental impact on the future of the Internet.

10. NSF’s Views on Partnerships • “NSF will also promote the development of partnerships to facilitate the sharing and integration of distributed technological components deployed and supported at national, international, regional, local, community, and campus levels. “ • “Significant resources already exist at the academic institution level. It is important to integrate such resources into the national cyberinfrastructure fabric.” • “NSF will promote the integration of campus-based cyberinfrastructure through interactions with campus CIOs and their organizations as well as with departments and individual faculty, to achieve holistic end-to-end cyberinfrastructure systems.” “NSF’S CYBERINFRASTRUCTURE VISION FOR 21ST CENTURY DISCOVERY,” July 2006 (v 7.1) See http://www.nsf.gov/oci (Office of Cyberinfrastructure)

11. Broader Engagement • How can TeraGrid engage the broader science, engineering, and education communities? • TeraGrid Strategies for Engagement • Science Gateways • Empower community-designed, led, supported infrastructure • Education and Training Initiatives • Create and support a community of educators and faculty • Campus Partnerships • New partnership programs (TeraGrid, OSG, Internet2, others)

12. TeraGrid Objectives • Campus Partnership “Requirements Analysis Team (RAT)” • Facilitators Gary Bertoline (Purdue University) and Scott Lathrop (University of Chicago) • Partnership Goals • Frameworks for collaboration in key areas of cyberinfrastructure • Embedded and operating within their natural habitats (e.g. EDUCAUSE, Internet2, OSG, campus infrastructure) • Designed, facilitated, and guided by Campus and national grid leaders together

13. Partnership Areas to Explore (1 of 2) • Integrated Authorization & Authentication • Improve CI usability for scientists and engineers on campuses, while increasing the security of CI • S. Goasguen (Clemson), J. Kyriannis (NYU), C. McMahon (LSU) • Integrated HPC and Data Management • Develop and deploy frameworks to support access to the increasingly powerful campus and national HPC investments, providing both capability and capacity services, and a storage and data management infrastructure to support open, extensible, evolvable science and engineering data collections • J. Boisseau (TACC), V. Agarwala (PSU), S. Corbato (Utah/Internet2)

14. Partnership Areas to Explore (2 of 2) • Integrated Data Collections and Digital Assets • Develop and deploy frameworks for assembly, management, access to, and curation of digital assets. • R. Moore (SDSC), S. Sivagnanam (SDSC), A. Doyle (UM/Internet2) • Expand CI Beyond only R1 Institutions • Develop and Cultivate an Affiliate Partnership Program to foster partnerships with and participation from underrepresented people, groups, and institutions. • J. Arnold (Internet2), G. Fox (Indiana), A. Ramirez (HACU), Gwen Jacobs (Montana State) • Expanded CI Education and Training Capabilities • Develop and harvest best-of-breed education and training materials; facilitate expanded education and training opportunities. • M. Sheddon (SDSC), K. Madhavan (Clemson), P. Teller (UTEP)

15. A Few Recommendations from the TeraGrid Campus Partnership RAT • Authentication & Authorization • It is recommended that TeraGrid enable attribute-based authorization to provide a growing community of users with access to computing and storage resources across all TeraGrid sites. • User Types: • Portal-based communities • InterGrid-based communities • Individual users from campuses (allocation on TeraGrid) • Users with individual credentials (no allocation on TeraGrid) • Educational users

16. A Few Recommendations from the TeraGrid Campus Partnership RAT • Cooperative Sharing of Digital Assets / Data Collections • Data Grids to support shared collections that reside on TeraGrid storage as well as campus storage. The shared collections are then available for analysis under Teragrid computer allocations. • Digital Libraries for publishing research data. This improves the ability to conduct research by improving access. Again the digital libraries can be distributed between campuses and the TeraGrid. • Persistent Archives for preserving records. Scientific data that are assessed as the digital holdings needed to support future research should be preserved. An example project is Chronopolis, a collaboration between UCSD, NCAR, U Md.

17. A Few Recommendations from the TeraGrid Campus Partnership RAT • Affiliates Partner Program • Organizational Affiliate: Affiliates like TeraGrid itself that naturally organize or create the National Cyberinfrastructure. • Industry Affiliate: Companies with interest in Cyberinfrastructure. • Centers of Excellence: An Affiliate that provides expertise to help others enhance their participation in the National Cyberinfrastructure, such as a supercomputer center • National Cyberinfrastructure Grid Operations Center: The set of affiliates providing distributed support to the distributed operation of the National Cyberinfrastructure. It works with dedicated support teams of resource providers. • Campus Partner: A campus affiliate. • Resource Provider: An affiliate providing National Cyberinfrastructure data, compute, sensor, instrument or network resources. • Access Site: An affiliate that accesses the National Cyberinfrastructure. • Community Affiliate: An affiliate or set of affiliates with a common interest. For example, one can expect individual MSI’s to be campus affiliates while organizations like MSICIEC, AIHEC, HACU and NAFEO are community affiliates. • Emerging communities: Communities that historically have been underrepresented in the high performance computing and Cyberinfrastructure arenas.

18. A Few Recommendations from the TeraGrid Campus Partnership RAT • Affilliates Partner Program • The TeraGrid should work with all players in the National Cyberinfrastructure • Centers of Excellence are required to advise and support Campus Partners • A broad pro-active program to enable Emerging Communities to become equal participants in the National Cyberinfrastructure

19. A Few Recommendations from the TeraGrid Campus Partnership RAT • Other recommendations related to MSI’s and emerging communities include: • Need for “Centers of Excellence” to help Cyberinfrastructure-enable emerging communities. Need a Nation Cyberinfrastructure Operations Center to help production use of the National Cyberinfrastructure by institutions that will initially not have local expertise to cope with complexity of problems in using distributed resources. • Need for a “simpler” “more robust” CI-Lite software stack as current Grid software requires significant staff to support, although the level of support that is needed appears not to be clearly documented. • Need for a plan to provide Systemic education and training at faculty, graduate and undergraduate levels. One should integrate Cyberinfrastructure into institutional curricula but the requisite content is not well defined.

20. A Few Recommendations from the TeraGrid Campus Partnership RAT • Education & Training- There will need to be a “Suite of Products” approach to introducing TeraGrid and recommendations include: • Champion at each partner site • Training for champions to help them chart a course to campus adoption • Demonstrations of capabilities and benefits of HPC to convince colleagues and administration of value of HPC • Campus IT person to act as campus ombudsman for HPC resources • Campus teams (IT, scientist, HPC champion) who could lead workshops for colleagues and share TeraGrid activities with them. This could be a prerequisite for becoming a TeraGrid Campus Partner. • Champions could get a DAC account to get their colleagues started. Then their colleagues will not need to go through the allocation process to get started.

21. A Few Recommendations from the TeraGrid Campus Partnership RAT • Education & Training- There will need to be a “Suite of Products” approach to introducing TeraGrid and recommendations include: • If champion does not have time to do these things, they might host the TeraGrid EOT team to come to their campus to provide training. • TeraGrid Speakers Bureau should become part of the training suite • Cyberinfrastructure Days on campuses could put together a series of activities if the campus champion would take care of marketing it on campus. Cyberinfrastructure Days would be a cooperative venture that would include TeraGrid, OSG, and Internet2. • Cyberinfrastructure Days will help to define the roll of the campus liaison (or champion) • CIP Science Seminar Series on computational science issues might be replicated TeraGrid-wide. • Access Grid and Webcasts should be used to train many users at multiple sites

22. TeraGrid, OSG, & Internet2 Discussions • There have been a series of meetings over the last few months between the leadership of TeraGrid, OSG, and Internet2. • The discussions have centered on the interest in forming a national cyberinfrastructure federation between the groups. • A few goals include: • a common authentication and authorization schema, • assist campuses with their cyberinfrastructure challenges • access to and sharing of resources • Campus Cyberinfrastructure Days to raise awareness and provide training

23. Major Challenges & Opportunities • Authentication & Authorization • Accounting • Campuses wanting to contributing resources • User support for campus faculty and staff • Inclusion of less cyber-enabled campuses • Campus Cyberinfrastructure Days to promote and raise awareness

24. Contributors • Miron Livny- OSG and University of Wisconsin • Ruth Pordes- OSG and Fermi Labs • Jill Arnold- Internet2 • Doug Van Houweling- Internet2 • Ken Klingenstein- Internet2 • Scott Lathrop- TeraGrid • Charlie Catlett- TeraGrid • Dane Skow- TeraGrid

25. Seeking Input • We are seeking your input from the user community • We have created an online survey for you to give us input: http://www.zoomerang.com/survey.zgi?p=WEB225XK47DJJC • Contacts if you wish to follow-up with more in depth discussions: • Gary Bertoline- bertoline@purdue.edu • Scott Lathrop- lathrop@mcs.anl.gov

26. Call for Participation • Papers, tutorials, posters, BOFs, and demonstrations are being accepted through January 12 in three tracks: Science, Technology, and Education, Outreach and Training • Submissions are being accepted for three competitions for high school, undergraduate and graduate students: • Impact of Cyberinfrastructure • Research posters • On-site advancing scientific discovery