Petascale Science Prototype Services Facility (PSPSF ) And Programmable WANs

1. Petascale Science Prototype Services Facility (PSPSF) And Programmable WANs Joe Mambretti, Director, (j-mambretti@northwestern.edu) International Center for Advanced Internet Research (www.icair.org) Northwestern University Director, Metropolitan Research and Education Network (www.mren.org) Co-Director, StarLight, (www.startap.net/starlight) Maxine Brown (maxine@uic.edu) Interim Director, Electronic Visualization Laboratory, University of Illinois at Chicago Co-Director, StarLight Tom DeFanti (tdefanti@soe.ucsd.edu) Research Scientist, California Institute for Telecommunications and Information Technology, University of California at San Diego Co-Director, StarLight Linda Winkler (winkler@mcs.anl.gov) Sr Network Engineer , Argonne National Lab Sr Network Engineer , StarLight Alan Verlo (darkman@evl.uic.edu) Associate Director , Electronic Visualization Laboratory, University of Illinois at Chicago Sr Network Engineer , StarLight GEC 19 Atlanta Georgia March 17-20, 2014

2. NG Digital Sky Survey Globus Alliance www.globus.org TeraGrid www.teragrid.org Carbon Tracker www.esrl.noaa.gov/ gmd/ccgg/carbontracker ANDRILL: Antarctic Geological Drilling www.andrill.org ALMA: Atacama Large Millimeter Array www.alma.nrao.edu GEON: Geosciences Network www.geongrid.org Comprehensive Large-Array Stewardship System www.class.noaa.gov DØ (DZero) www-d0.fnal.gov ISS: International Space Station www.nasa.gov/station CAMERA metagenomics camera.calit2.net IVOA: International Virtual Observatory www.ivoa.net Pacific Rim Applications and Grid Middleware Assembly www.pragma-grid.net Sloan Digital Sky Survey www.sdss.org GLEON: Global Lake Ecological Observatory Network www.gleon.org BIRN: Biomedical Informatics Research Network www.nbirn.net ATLAS LHCONE www.lhcone.net CineGrid www.cinegrid.org OOI-CI ci.oceanobservatories.org LIGO www.ligo.org XSEDE www.xsede.org OSG www.opensciencegrid.org WLCG lcg.web.cern.ch/LCG/public/ SKA www.skatelescope.org Compilation By Maxine Brown

3. TransLight/StarLightPetascale Science Prototype Services Facility • Goal: Prototyping Trans-Atlantic 100 Gbps Architectures, Services, and Emerging Technologies Among Institutions Connected to NetherLight, StarLight, and Other Participating GOLEs in North America and Europe • The TransLight/StarLight Consortium Has Been Awarded a National Science Foundation (NSF) Grant To Establish An Initiative To Design and Implement Network Architectures, Services, Technologies, and Core Capabilities In Support of Big Data Science Over 100 Gbps Trans-Atlantic Paths, Enabling Large-Scale Global Scientific Research Experiments, Instrumentation Access, Collaborations, Data Sharing and High-Resolution Visualization.

4. TransLight/StarLightPetascale Science Prototype Services Facility • This Project Is Designing, Implementing, and Experimenting With Prototype Services and Capabilities That Have the Potential to Optimize Advanced Networks for Production Science Research, Particularly for Large-Scale Data Transport, Including Persistent, Ultra-Large-Capacity, Real-Time, Long-Duration Streams. These Experiments Are Being Conducted With Multiple National and International Partners. • Four Major Themes of This Initiative Are To Provide: (a) Large-Scale Network Capacity, Including Support For Extremely High-Volume Individual Data Streams, (b) Network Services and Resource Programmability For This Capacity, (c) Edge Access To These Capabilities, and (d) Exchange Facilities That Can Support These Services and Capabilities.

5. Selected PSPSF Applications at 100 G • SDN, Science DMZ • WAN/LAN High-Performance Large capacity Flows and File Transfers • Computational Genomics and Analytics • Open Science Data Cloud (HPC Clouds) • DataScope (Computational Astrophysics) • LHC Research • 8K Digital Media Streaming • SAGE Streaming (Scientific Visualization) • Network Science Experimental Research (Including GENI/iGENI and International Network Research Testbeds) • Petascale Computational Science (e.g., Blue Waters, Titan) • 8k Digital Media/HPDMnet • CineGrid • HPC Storage Streaming

6. StarLight – “By Researchers For Researchers” StarLight Is An Experimental And Production Optical Infrastructure Based Proving Ground for Advanced Network Services Optimized for High-Performance Data Intensive Applications Abbott Hall, Northwestern University’s Chicago Campus View from StarLight

7. Relatively Current StarLight Infrastructure Ciena OME, 5410 Calient PXC (L1) Juniper MX 960 (L2/L3) Many Lambdas & Collaborators Many 100 G Paths http://wiki.glif.is/index.php/StarLight Measurement Servers: bwctl, owamp, ndt/npad, perfSONAR StarLight International/National Communications Exchange Facility

8. The Global Lambda Integrated FacilitySupports Multiple Advanced Networks Visualization courtesy of Bob Patterson, NCSA; data compilation by Maxine Brown, UIC. www.glif.is

9. StarWave: A Multi-100 Gbps Exchange Facility • StarWave, An Advanced Multi-100 Gbps Exchange Facility and Services Implemented Within the StarLight International/National Communications Exchange Facility • StarWave Was Implemented In 2011 To Provide Services To Support Large Scale Data Intensive Science Research Initiatives • StarWave Was Developed With Support from an NSF Advanced Research Infrastructure Award • StarWaveSupported Multiple SC13 Demonstrations

11. CA*net/Ciena/StarLight/iCAIR 100 Gbps Testbed 1st Implemented In Sept 2010, Implemented Periodically Since 100 Gbps Source: CANARIE

12. CVS Terrestrial Demo Content & Applications – 100G Ottawa MEN LAB 10 100G Connectivity from Ciena Ottawa to Starlight Gigapop in Chicago. Ability to show simultaneous data-flows sourced from major collaborators. MEN LAB 10 Tile Display Chicago 100Gbps Demonstration North American First Montreal Canadian Brain Imaging Network CBRAIN portal & Metadata Source: Rod Wilson, Ciena

13. SC13 100 Gbps NRE Demonstrations • 100 Gbps Networks for Next Generation Petascale Science Research and Discovery • Data-Scope at 100 Gbps Across National Data-Intensive Computational Science Testbeds • Next Generation Genome Sequencing Data at 100 Gbps • The Global Environment for Network Innovations (GENI) at 100 Gbps • HPC Open Science Data Cloud (OSDC) for Data Intensive Research at 100 Gbps • Using Remote I/O for Large-Scale Long Distance Data Storage and Processing • ExoGENI @ 40G: Dynamic Monitoring and Adaptation of Data Driven Scientific Workflows Using Federated Cloud Infrastructure

15. 100 Gbps NIC

16. Several SC13 Petascale Science Demonstrations Incorporated 100 Gbps NIC Development Funded By Department of Energy’s Office of Science

20. Overview of the Alex’s Data-Scope • Data-Scope Is An NSF Funded Novel Instrument Designed To Observe Extremely Large Data Sets • Data-Scope Was Implemented To Undertake Highly Data-Intensive Analyses Simply Not Possible Anywhere Else Today • 6.5 PB of Fast Storage • Sequential IO 500Gbytes/sec • 10G Interconnect local • 100G External Connectivity • 96 Servers • 100 Gbps LAN and WAN Connectivity Source: Alex Szalay

21. SDSS Images Quasar Spectra Field of Streams Composite Survey Image Whirpool Galaxy Galaxy Map

22. Multiple HPC Cloud Computing Testbeds Specifically Designed for Science Research At Scale Experimentation Integerated With High Performance Networks

23. Multiple Demonstrations at GENI Engineering Conferences

25. LHCONE

28. GLIF AutoGOLE Initiative Oct 2013

29. Source: John MacAuley SC13 iCAIR

30. www.startap.net/starlight Thanks to the NSF, DOE, NASA DARPA, Universities, National Labs, International Partners, Corporate Partners and Other Supporters