1 / 27

“Driving Applications on the UCSD Big Data Freeway System”

“Driving Applications on the UCSD Big Data Freeway System”. Keynote Lecture Cubic and UC San Diego Innovation Workshop UC San Diego February 26, 2014. Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor,

rea
Download Presentation

“Driving Applications on the UCSD Big Data Freeway System”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “Driving Applications on the UCSD Big Data Freeway System” Keynote Lecture Cubic and UC San Diego Innovation Workshop UC San Diego February 26, 2014 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology Harry E. Gruber Professor, Dept. of Computer Science and Engineering Jacobs School of Engineering, UCSD http://lsmarr.calit2.net

  2. The Data-Intensive Discovery Era Requires High Performance Cyberinfrastructure • Growth of Digital Data is Exponential • “Data Tsunami” • Driven by Advances in Digital Detectors, Computing, Networking, & Storage Technologies • Shared Internet Optimized for Megabyte-Size Objects • Need Dedicated Photonic Cyberinfrastructure for Gigabyte/Terabyte Data Objects • Finding Patterns in the Data is the New Imperative • Data-Driven Applications • Data Mining • Visual Analytics • Data Analysis Workflows Source: SDSC

  3. The White House AnnouncementHas Galvanized U.S. Campus CI Innovations

  4. CERN’s CMS ExperimentGenerates Massive Amounts of Data

  5. UCSD is a Tier-2 LHC Data Center:CMS Flow into UCSD Physics Dept. Peaks at 2.4 Gbps Source: Frank Wuerthwein, Physics UCSD

  6. Planning for climate change in California substantial shifts on top of already high climate variability UCSD Campus Climate Researchers Need to Download Results from Remote Supercomputer Simulations to Make Regional Climate Change Forecasts Dan Cayan USGS Water Resources Discipline Scripps Institution of Oceanography, UC San Diego much support from Mary Tyree, Mike Dettinger, Guido Franco and other colleagues Sponsors: California Energy Commission NOAA RISA program California DWR, DOE, NSF

  7. GFDL A2 1km downscaled to 1km Hugo Hidalgo Tapash Das Mike Dettinger average summer afternoon temperature average summer afternoon temperature

  8. Protein Data Bank (PDB) NeedsBandwidth to Connect Resources and Users Archive of experimentally determined 3D structures of proteins, nucleic acids, complex assemblies One of the largest scientific resources in life sciences Virus Source: Phil Bourne and Andreas Prlić, PDB Hemoglobin

  9. Protein Data Bank Usage Is Growing Over Time More than 300,000 Unique Global Visitors per Month Up to 300 Concurrent Users ~10 Structures are Downloaded per Second 7/24/365 Increasingly Popular Web Services Traffic Source: Phil Bourne and Andreas Prlić, PDB

  10. Collaboration Between EVL’s CAVE2 and Calit2’s VROOM Over 10Gb Wavelength Calit2 EVL Source: NTT Sponsored ON*VECTOR Workshop at Calit2 March 6, 2013

  11. Global Innovation Centers are Being Connected with 10,000 Megabits/sec Clear Channel Lightpaths 100 Gbps Commercially Available; Research on 1 Tbps Source: Maxine Brown, UIC and Robert Patterson, NCSA

  12. Creating a Big Data Freeway System:Use Optical Fiber with 1000x Shared Internet Speeds NSF CC-NIE Has Awarded Prism@UCSD Optical Switch Phil Papadopoulos, SDSC, Calit2, PI

  13. Arista Enables SDSC’s Massively Parallel 10G Switched Data Analysis Resource 12

  14. High Performance Wireless Research and Education Network http://hpwren.ucsd.edu/ National Science Foundation awards 0087344, 0426879 and 0944131

  15. HPWREN Topology, 360 Degree Cameras Backbone/relay node Astronomy science site Biology science site Earth science site University site Researcher location Native American site First Responder site 155Mbps FDX 6 GHz FCC licensed 155Mbps FDX 11 GHz FCC licensed 45Mbps FDX 6 GHz FCC licensed 45Mbps FDX 11 GHz FCC licensed 45Mbps FDX 5.8 GHz unlicensed 45Mbps-class HDX 4.9GHz 45Mbps-class HDX 5.8GHz unlicensed ~8Mbps HDX 2.4/5.8 GHz unlicensed ~3Mbps HDX 2.4 GHz unlicensed 115kbps HDX 900 MHz unlicensed 56kbps via RCS network via Tribal Digital Village Network dashed = planned WIDC KYVW KNW B081 BDC PFO GVDA Santa Rosa WMC RDM AZRY CRY BZN SND KSW SMER FRD DHL MPO SO P474 SLMS LVA2 BVDA SCS GLRS P478 P486 MTGY MVFD P510 WLA P483 CRRS GMPK RMNA USGC DSME CWC P506 P499 P480 P509 CE MONP UCSD 70+ miles to SCI P497 MLO DESC P494 P473 IID2 SDSU P500 CNM PL P066 POTR NSSS to CI and PEMEX Red circles: HPWREN supplied cameras Yellow circles: SD County supplied cameras approximately 50 miles: Source: Hans Werner Braun, HPWREN PI Note: locations are approximate

  16. Various Real-Time Network Cameras for Environmental Observations Source: Hans Werner Braun, HPWREN PI

  17. San Diego County Digital Weather Stations:High Spatial Density Reads Out Time-Changing Atmosphere Source: Jessica Block, Calit2

  18. Trigger real-time computer-generated alerts, if: condition “A” AND condition “B” AND condition “C” OR condition “D” exists, in which case several San Diego emergency officers are being paged or emailed during such alert conditions, based on HPWREN data parameterization by a CDF Division Chief. This system has been in operation since 2004. Relative Humidity Wind speed Wind direction Fuel moisture Date: Wed, 4 Aug 2010 09:31:05 -0700 Subject: URGENT weather sensor alert LP: RH=26.1 WD=135.2 WS=1.9 FM=6.8 AT=80.7 at 20100804.093100 More details at http://hpwren.ucsd.edu/Sensors/ Source: Hans Werner Braun, HPWREN PI

  19. By Measuring the State of My Body and “Tuning” ItUsing Nutrition and Exercise, I Became Healthier I Arrived in La Jolla in 2000 After 20 Years in the Midwestand Decided to Move Against the Obesity Trend Age 61 Age 41 Age 51 1999 2010 2000 1999 1989 I Reversed My Body’s Decline By Quantifying and Altering Nutrition and Exercise http://lsmarr.calit2.net/repository/LS_reading_recommendations_FiRe_2011.pdf

  20. I Used a Variety of Emerging Personal SensorsTo Quantify My Body & Drive Behavioral Change Withings/iPhone- Blood Pressure FitBit -Daily Steps & Calories Burned MyFitnessPal-Calories Ingested Azumio-Heart Rate Withings WiFi Scale -Daily Weight Zeo-Sleep

  21. From One to a Billion Data Points Defining Me:Big Data Coming to the Electronic Medical Record (EMR) Microbial Genome Billion: My Full DNA, MRI/CT Images Tomorrow’s EMR SNPs Million: My DNA SNPs, Zeo, FitBit Today’s EMR Blood Variables One: My Weight Hundred: My Blood Variables Weight

  22. Visualizing Time Series of 150 LS Blood and Stool Variables, Each Over 5-10 Years Calit2 64 megapixel VROOM

  23. Only One of My Blood Measurements Was Far Out of Range--Indicating Chronic Inflammation 27x Upper Limit Episodic Peaks in Inflammation Followed by Spontaneous Drops Normal Range <1 mg/L Normal Complex Reactive Protein (CRP) is a Blood Biomarker for Detecting Presence of Inflammation

  24. Consumer Self Measurement is ExplodingTotally Outside of the Medical Complex From the First San Francisco QS Meetup in 2008To 116 Cities in 37 Countries in Four Years

  25. The Self-Monitoring BusinessHas Reached Market Takeoff More Mergers Likely as the Shakeout Continues • MyFitnessPal • 40 Million Users • Aug 2013 Raised $18M Series A, Led by Kleiner Perkins • Fitbit • Has Raised ~$70M • BodyMedia Was Bought by Jawbone • For ~$100M • Zeo Sleep Monitor • Closed Down in 2013

  26. mHealth Technology Progression Mobile Health Market Projected to be $30B-$60B by 2015 Source: Rick Valencia, Qualcomm Life

  27. Platforms Enable Expanding EcosystemsEmpowering Many to Serve Diverse Customer Sets Source: Kristian Rauhala, PEAR Sports LLC

More Related