1 / 19

“An Integrated Science Cyberinfrastructure for Data-Intensive Research”

“An Integrated Science Cyberinfrastructure for Data-Intensive Research”. Panel CISCO Executive Symposium San Diego, CA June 9, 2015. Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor,

jsommers
Download Presentation

“An Integrated Science Cyberinfrastructure for Data-Intensive Research”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “An Integrated Science Cyberinfrastructure for Data-Intensive Research” Panel CISCO Executive Symposium San Diego, CA June 9, 2015 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD http://lsmarr.calit2.net

  2. The Data-Intensive Discovery Era Requires High Performance Cyberinfrastructure • Growth of Digital Data is Exponential • “Data Tsunami” • Driven by Advances in Digital Detectors, Computing, Networking, & Storage Technologies • Shared Internet Optimized for Megabyte-Size Objects • Need Dedicated Photonic Cyberinfrastructure for Gigabyte/Terabyte Data Objects • Finding Patterns in the Data is the New Imperative • Data-Driven Applications • Data Mining • Visual Analytics • Data Analysis Workflows Source: SDSC

  3. Vision: Creating a “Big Data Freeway” Use Lightpaths to Connect All Data Generators and Consumers, Creating a “Big Data” Plane Integrated With High Performance Global Networks This Vision Has Been Building for Over Two Decades

  4. Academic Research “OptIPlatform” Cyberinfrastructure:A 10Gbps Lightpath Cloud HD/4k Video Cams HD/4k Telepresence Instruments HPC End User OptIPortal 10G Lightpath National LambdaRail Campus Optical Switch Data Repositories & Clusters HD/4k Video Images

  5. Cisco CWave for CineGrid: A New Cyberinfrastructurefor High Resolution Media Streaming* CWave core PoP 10GE waves on NLR and CENIC (LA to SD) Source: John (JJ) Jamison, Cisco PacificWave 1000 Denny Way (Westin Bldg.) Seattle StarLight Northwestern Univ Chicago Level3 1360 Kifer Rd. Sunnyvale McLean 2007 Equinix 818 W. 7th St. Los Angeles Cisco Has Built 10 GigE Waves on CENIC, PW, & NLR and Installed Large 6506 Switches for Access Points in San Diego, Los Angeles, Sunnyvale, Seattle, Chicago and McLean for CineGrid Members CENIC Wave Calit2 San Diego * May 2007

  6. CENIC is Rapidly Moving to Connect at 100 Gbps Across the State and Nation DOE Internet2

  7. Particle Physics: Creating a 10-100 Gbps LambdaGrid to Support LHC Researchers LHC Data Generated by CMS & ATLAS Detectors Analyzed on OSG CMS ATLAS Flow Out of CERN for CMS DetectorPeaks at 32 Gbps!

  8. Cancer Genomics Hub (UCSC) is Housed in SDSC CoLo:Large Data Flows to End Users 1G 8G Cumulative TBs of CGH Files Downloaded 30 PB 15G Data Source: David Haussler, Brad Smith, UCSC

  9. Automated Telescope SurveysAre Creating Huge Datasets 250 images per night. 530MB per raw image 150 GB per night 800GB per night 300 images per night. 100MB per raw image 30GB per night 120GB per night When processed at NERSC Increased by 4x Source: Peter Nugent, Division Deputy for Scientific Engagement, LBL Professor of Astronomy, UC Berkeley

  10. Planning for climate change in California substantial shifts on top of already high climate variability SIO Campus Climate Researchers Need to Download Results from Remote Supercomputer Simulations to Make Regional Climate Change Forecasts Dan Cayan USGS Water Resources Discipline Scripps Institution of Oceanography, UC San Diego much support from Mary Tyree, Mike Dettinger, Guido Franco and other colleagues Sponsors: California Energy Commission NOAA RISA program California DWR, DOE, NSF

  11. Interactively Exploring Microscope Images of Brains:40Gbps From NCMIR to Calit2 64Mpixel Wall

  12. Collaboration Between EVL’s CAVE2 and Calit2’s VROOM Over 10Gb Wavelength Calit2 EVL Source: NTT Sponsored ON*VECTOR Workshop at Calit2 March 6, 2013

  13. The White House AnnouncementHas Galvanized U.S. Campus CI Innovations

  14. Creating a “Big Data” Plane on Campus:NSF Funded Prism@UCSD and CHeruB CHERuB Prism@UCSD, Phil Papadopoulos, SDSC, Calit2, PI CHERuB, Mike Norman, SDSC PI

  15. Making Critical High Performance CyberinfrastructureSeamlessly Available to Users Where They Work # of Parallel 10Gbps Optical Light Paths Prism@UCSD TSCC & Co-Lo CHERuB 8 10 1-16 4 288 4 8 1 128 SDSC Supercomputers UCSD IDI Users 384 384 x 10Gbps = 3.8Tbps Oasis Data Store >13,000 TB > 800 Gbps Gordon

  16. High Performance Computing and StorageBecome Plug Ins to the “Big Data” Plane

  17. The Pacific Research PlatformCreates a Regional Big Data Cyberinfrastructure Map Source: John Hess, CENIC Optical Connections 10-100 Gbps Organized by Calit2 and CITRIS

  18. Ten Week Sprint to Demonstrate the West CoastBig Data Freeway System Presented at CENIC 2015 March 9, 2015

  19. The National Science FoundationHas Funded Over 100 Campuses to Build Data Freeways 134 awards, 128 projects - All but 4 states - 120+ institutions

More Related