DOE Facilities - Drivers for Science: Experimental and Simulation Data

1. DOE Facilities - Drivers for Science: Experimental and Simulation Data Richard Carlson – ASCR PM Richard.Carlson@science.doe.gov Joint Techs Winter 2012 Jan 24, 2012 Baton Rouge, LA

2. Advanced Scientific Computing Research- Program Office 2

3. DOE Facilities

4. DOE Science

5. Next-Generation Networks for Science Mission: The Goals of the program are 1) to research, develop, test and deploy advanced network technologies critical in addressing networking capabilities unique to DOE’s science mission and 2) identify scientific principles that lead to understanding about network and application behavior.  The program’s portfolio consists of two main elements: High-Performance Networks High-Performance Middleware DOE ESnet

6. Data Transfer Basics • Time to transfer 1 TB on various networks • 1 TB/hour uses ¼ of a 10 Gbps network • 10 TB/hour uses ¼ of a 100 Gbps network • 100 TB/hour uses ¼ of a 1 Tbps network • Conversely a 1 Tbps network will move 10 PB/day • Real-time aspects at 100 Gbps • Voice (128B): 20.5 nsec/packet • Jumbo frame Ethernet (9KB): 720 nsec/packet

7. CEDPS - SaaS Data Management Moving 322 TeraBytes of data from ANL to each remote site 7.34 Days to NERSC 18.56 Days to ORNL 4.1 Gbps 1.6 Gbps

8. Esnet – DOE’s R&D Network

9. DOE Distributed Science Complex

10. Challenges for Next-Gen Program • Develop a fundamental understanding about how DOE scientists use networks and how those networks behave • Provide scientists with advanced technologies that simplify access to experimental facilities, Supercomputers and scientific data • Provide dynamic and hybrid networking capabilities to support diverse types of high-end science applications at scale.

11. Themes and Portfolio Directions 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Challenges: Massively parallel data streams Massive numbers of independent collaborations Understanding complex network infrastructures Extreme collaborations with 100K+ participants Risk-informed decision-making through modeling and simulation Creating hybrid networks Managing large collaboration space Effectively identifying performance bottlenecks Routine movement of terabyte datasets Middleware libraries and APIs for Large Systems Grid infrastructures and data management services Multi-layer hybrid network control systems Multi-domain monitoring and measurement systems Network/Middleware Core Research: ESnet Traffic 100 PB 20 PB 50 EB 1 EB 10 EB ESnet Backbone Capacity 400 Gbps 100 Gbps 4 Tbps 1 Tbps 10 Tbps Research Activities: Scalable network – middleware architectures, protocols, and services Federated scientific collaborations Computational Science for ASCR Radical new network architecture/protocols Comprehensive scientific workflow services Science driven on-demand circuits 100 GE LAN/MAN/WAN integration Comprehensive data mgt service Fast data movement service 100 Gbps NICs Application performance analysis service Emergent Area Research

12. Research Questions and Directions • Predictable • Develop networks, tools, and services that offer predictable performance to a user. • Guaranteed • Develop networks, tools, and services that guarantee some level of performance. • Scientific Understanding • Identify why the network or application behave in the observed manner. • Advanced tools and services • Tools and services to allow scientists to complete their tasks without worrying about the infrastructure.