130 likes | 144 Views
An integrated study of datacenter networking and 100GigE wide-area networking in support of distributed scientific computing. Zhengyang Liu University of Virginia zl4ef@virginia.edu Sept. 30, 2011. This work was carried out as part of a sponsored research project from the NSF OCI-1127340.
E N D
An integrated study of datacenter networking and 100GigE wide-area networking in support of distributed scientific computing • Zhengyang Liu • University of Virginia • zl4ef@virginia.edu • Sept. 30, 2011 This work was carried out as part of a sponsored research project from the NSF OCI-1127340
Problem Statement • Poor end-to-end application-level performance • 200MB/s over 10Gb/s connection -> less than 20% utilization
Problem Statement • Data Analysis • Networking Solutions Evaluation • New Technology Development
Data Analysis • Applications • Benchmark • Profiling • Network • Active Measurements • Passive Measurements
Current Work • Learn! • Revisit Networking: A Statistical Approach • Datacenter Networking: InfiniBand, RoCE, iWARP • Iperf • Netflow
Current Work • Preliminary Tests on Our Own Resources • PC / VM / EC2 • Getting familiar with tools: GridFTP, Ganglia, etc. • Preliminary Tests on ANI Testbed
Future Work • Immediate ToDo • Continue Learning • GridFTP tests on ANI • Per-process Monitoring Solution (DTrace?)
A (nascent) Analyzing Framework Iperf What could happen? Netflow What happened inside the network? Ganglia What happened inside the host? DTrace What happened inside the application?
Future Work • Within 1st Year • Further Analysis • Integrate IDC with GridFTP • Publish Results
Future Work • Finish the Project!