Cornell Theory Center Windows High Performance Computing Solutions Center

1. Cornell Theory CenterWindows High Performance Computing Solutions Center Supporting World Class Computational Science http://www.tc.cornell.edu/WhoWeAre/AboutCTC/index.asp Worlds First, and Largest, All Windows Production HPC Facility http://www.tc.cornell.edu/Services/Cluster/index.asp Corporate Program http://www.tc.cornell.edu/Corporate/index.asp CTC Manahattan A Globally Accessible Center Providing High Performance Computing Solutions to Today’s Business and Finance Problems located in the heart of the Financial District. A Center of Excellence in High Performance Computing and Interdisciplinary Research located at Cornell University

2. Microsoft Windows High Performance ComputingSupporting over 100 Diverse Areas of Research at Cornell Computational Biology Service Unit http://cbsu.tc.cornell.edu/index.htm Computational Genomics http://www.genomics.cornell.edu/focus_areas/computational/ Computational Materials Institute http://www.tc.cornell.edu/Research/CMI/index.asp Computational Finance http://www.ctc-manhattan.com/Research/index.asp Cornell Institute for Social and Economic Research http://www.ciser.cornell.edu/

4. CTC Clusters

6. Data Intensive ComputingSeamless Open Interfaces to Data Sources • Arecibo - World’s largest Radiotelescope • Johannes Gehrke, Jim Cordes, David Lifka, Jim Gray • Serving Astronomy Data via SQL Server and Web Services • http://arecibo.tc.cornell.edu/arecibo/index.aspx • http://www.cs.cornell.edu/johannes/ Computational Materials Institute Tony Ingraffea, Keshav Pingali Serving Finite Element Models via SQL Server and Web Services http://www.tc.cornell.edu/Research/CMI/Multiscale/index.asp Physically Accurate Imagery Steve Marschner http://www.cs.cornell.edu/~srm/ The Structure and Evolution of the Web William Arms http://www.cs.cornell.edu/wya/

7. The Velocity Scheduler Motivation • What makes one Job Scheduler better than another? • Job Schedulers match resource requests to resources • Job Schedulers provide mechanisms to implement policies • Job Schedulers should be integrated with Resource Management • Ease of Use & Administration • Let the Database do the work • Designed to perform tasks like resource matching • Implementing Scheduling Algorithms and Policies is straight forward • Ideal tool for Scalable Resource Management • Don’t Reinvent what the Platform Provides • Windows Server 2003 – Delegation & Impersonation • Active Directory • SQL Server • Windows Management & Instrumentation • Microsoft Message Queues • Performance Alerts • Identify “poison nodes” • Node changes

8. submit submit submit submit submit submit submit submit submit submit restart restart restart restart restart cancel cancel cancel cancel cancel submit submit submit submit submit RequestManager RequestManager RequestManager RequestManager RequestManager JobScheduler JobScheduler JobScheduler JobScheduler JobScheduler Connecting to the Grid with Standard Windows Components Certificate Server Web Server (IIS 6.0) Security TokenServer Local Job Scheduling & Resource Management Domain Controller SQL Certificate Database Clusters Workstations SQL HPC Data Sources

9. Gordon Bell, senior researcher at Microsoft's Bay Area Research Center, concurs. "This project demonstrates the potential of a new way to build applications and the potential for a new software industry structure based on delivering results," he said. "Users don't have to buy apps programs and maintain a more complex software environment; they simply call a program or database. This is one of the few projects that I would call a Web Service, and it is well beyond what is running on today's experimental Grid.“ • Frederica Darema, Senior Science and Technology Advisor in the CISE Directorate at NSF, is the cognizant NSF official for the ASP project. "It is to the credit of the scientists working on this project that they have developed such a cohesive collaboration," she said. "I am pushing for a new paradigm in application simulation and measurement capabilities called Dynamic Data Driven Application Systems, and the ASP model of multidisciplinary collaboration, together with the technology advances made by the project, are essential for enabling this new paradigm. I am very pleased with the outcomes of this project and its broader impact."

10. Visualization CTC Visualization Information http://www.tc.cornell.edu/Services/Vis Innovative use of Windows based Virtual Reality and Visualization Using the CAVE to explore the three-dimensional structures of proteins OpenDX http://www.tc.cornell.edu/Services/Vis VTK for CAVE Animations http://www.tc.cornell.edu/Services/vis/Cave

11. Summary • The CTC Approach Windows HPC • Community Served Cornell Research Community and Collaborators • Why TCO, Usability, Integrated Security, Development Environment, Innovation • Costs Hardware, Software, People • Allocation Issues Pier Reviewed based on Academic Merit • Cost Recovery Industry Clients & Partnerships, State & Federal Funding Agencies • Proud of CTC making the Windows HPC vision a reality. • Gotchas Never get too Comfortable with a Solution. • - expect more • - always look to the future