80 likes | 89 Views
Learn how Gigabyte bandwidth enables global co-laboratories for massive data analysis in science experiments. Explore the evolution of network speeds, future predictions, and the impact on collaborative research. Presented at the Windows Hardware Engineering Conference in 2004.
E N D
Gigabyte Bandwidth Enables Global Co-Laboratories Prof. Harvey Newman, Caltech Jim Gray, Microsoft Presented at Windows Hardware Engineering Conference Seattle, WA, 2 May 2004
Challenges Faced by Global Science Experiments Today 500+ Physicists 100+ Institutes 35+ Countries • Analysis and development • Global • Distributed • Cooperative • Massive amounts of data • ~1 Gigabytes per second • ~20 Petabytes per year • Gigabyte bandwidth required 2007 5,000+ Physicists 250+ Institutes 60+ Countries CMS Atlas
Tier 0 +1 CERN Tier 1 FNAL INFN INP3 RAL Tier 2 Filter Tier 2 Tier 2 Tier 2 Tier 2 Tier 2 Tier 4 Tier 3 Institute Institute Institute Institute LHC Datal Grid Hierarchy Developed at Caltech ~PBps ~1 GBps Experiment ~5 GBps … ~1 GBps ~1 GBps Physics data cache 30Petabytes by 20081 Exabyte by 2014 .1 GBps Workstations
Global Integrated Systemshttp://ultralight.caltech.edu OC192 = 9.9 Gbps
Send data from CERN to Caltech – Fast Use standard TCP/IP Rules set by Internet2 @ http://lsr.internet2.edu/ OC 192 = 9.9 Gbps Internet2 Land Speed Records 64 bit New speed record, multiple parallel streams: 6.8 gbps~ 850 mBps 6.2 gbps ~ 800 mBps 7,000 6,000 5,000 4,000 mbps per second 3,000 2,000 1,000 0 2000 2001 2002 2003 2004 2005
OC 192 = 9.9 Gbps 4:42 AM 6.8 Gbps
Windows Disk IO Bandwidth Details at: http://research.microsoft.com/~peteku/
Futures • Beyond TCP/IP • Predictable stability • Better error and congestion control • Hybrid networks with dynamic optical paths • Higher speed links • Truly global collaboration and virtual organizations