110 likes | 236 Views
OptIPuter Goal: Removing Bandwidth Barriers to e-Science. Sloan Digital Sky Survey. ALMA. LHC. ATLAS. Why Optical Networks Will Become the 21 st Century Driver. Optical Fiber (bits per second) (Doubling time 9 Months). Data Storage (bits per square inch) (Doubling time 12 Months).
E N D
OptIPuter Goal:Removing Bandwidth Barriers to e-Science Sloan Digital Sky Survey ALMA LHC ATLAS
Why Optical NetworksWill Become the 21st Century Driver Optical Fiber (bits per second) (Doubling time 9 Months) Data Storage (bits per square inch) (Doubling time 12 Months) Silicon Computer Chips (Number of Transistors) (Doubling time 18 Months) Performance per Dollar Spent 0 1 2 3 4 5 Number of Years Scientific American, January 2001
The OptIPuter Project – Removing Bandwidth as an Obstacle In Data Intensive Sciences • NSF Large Information Technology Research Proposal • UCSD and UIC Lead Campuses—Larry Smarr PI • USC, UCI, SDSU, NW, TA&M Partnering Campuses • Industrial Partners: IBM, Sun, Telcordia/SAIC, Chiaro, Calient • $13.5 Million Over Five Years • Optical IP Streams From Lab Clusters to Large Data Objects NIH Biomedical Informatics Research Network NSF EarthScope http://ncmir.ucsd.edu/gallery.html siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml
Application Barrier One:Gigabyte Data Objects Need Interactive Visualization • Montages--Hundred-Million Pixel 2-D Images • Microscopy or Telescopes • Remote Sensing • GigaZone 3-D Objects • Seismic or Medical Imaging • Supercomputer Simulations • Interactive Analysis and Visualization of Such High Resolution Data Objects Requires: • Scalable Visualization Displays • Montage and Volumetric Visualization Software • UIC EVL’s JuxtaView and Vol-a-Tile
OptIPuter Project Goal:Scaling to 100 Million Pixels • JuxtaView (UIC EVL) on PerspecTile LCD Wall • Digital Montage Viewer • 8000x3600 Pixel Resolution~30M Pixels • Display Is Powered By • 16 PCs with Graphics Cards • 2 Gigabit Networking per PC NCMIR – Brain Microscopy (2800x4000 24 layers) Source: Jason Leigh, EVL, UIC; USGS EROS
Application Barrier Two:Campus Grid Infrastructure is Inadequate • Campus Infrastructure is Designed for Web Objects • Being Swamped by Sharing of Digital Multimedia Objects • Little Strategic Thinking About Needs of Data Researchers • Challenge of Matching Storage to Bandwidth • Need To Ingest And Feed Data At Multi-Gbps • Scaling to Enormous Capacity • Use Standards-Based Commodity Clusters (Rocks) • OptIPuter Aims at Prototyping a National Architecture • Federated National and Global Data Repositories • Lambdas on Demand • Campus Laboratories Using Clusters with TeraBuckets • Campus Eventually with a Shared PetaCache
OptIPuter 2004 @ UCSDCoupling Linux Clusters with High Resolution Visualization
OptIPuter is Studying the Best Application Usagefor Both Routed vs. Switched Lambdas • OptIPuter Evaluating Both: • Routers • Chiaro, Juniper, Cisco, Force10 • Optical Switches • Calient, Glimmerglass • Lightpath Accelerators • BigBandWidth • UCSD Focusing on Routing Initially • UIC Focusing on Switching Initially • Next Year Merge into Mixed Optical Fabric Chiaro Estara Glimmerglass
Application Barrier Three:Shared Internet Makes Interactive Gigabyte Impossible • NASA Earth Observation System • Over 100,000 Users Pull Data from Federated Repositories • Two Million Data Products Delivered per Year • 10-50 Mbps (May 2003) Throughput to Campuses • Typically Over Abilene From Goddard, Langley, or EROS • Biomedical Informatics Research Network (BIRN) • Between UCSD and Boston • Similar Story • Lots of Specialized Networking Tuning Used • 50-80 Mbps • Remote Interactive Megabyte is Possible • But Interactive Gigabyte is Impossible IP over Lambdas with Alternate Protocols
Multi-Latency OptIPuter LaboratoryNational-Scale Experimental Network Chicago OptIPuter StarLight NU, UIC USC, UCI UCSD, SDSU SoCal OptIPuter “National Lambda Rail” Partnership Serves Very High-End Experimental and Research Applications 4 x 10GB Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout 2000 Miles 10 ms =1000x Campus Latency Source: Tom West, CEO NLR (Booth 3409)
An International-Scale OptIPuter is Operational over the First Set of 76 International GE TransLight Lambdas European lambdas to US –8 GEs Amsterdam— Chicago –8 GEs London—Chicago Canadian lambdas to US –8 GEsChicago— Canada —NYC –8 GEs Chicago— Canada —Seattle US lambdas to Europe –4 GEs Chicago—Amsterdam –3 GEs Chicago— CERN European lambdas –8 GEs Amsterdam—CERN –2 GEs Prague—Amsterdam –2 GEs Stockholm—Amsterdam –8 GEs London—Amsterdam TransPAC lambda –1 GE Chicago—Tokyo IEEAF lambdas (blue) –8 GEs NYC—Amsterdam –8 GEs Seattle—Tokyo NorthernLight UKLight CERN Source: Tom DeFanti, EVL, UIC