120 likes | 224 Views
The LAC/UIC experiences through JGN2/APAN during SC04. Katsushi Kouyama and Kazumi Kumazoe Kitakyushu JGNⅡ Research Center / NiCT Robert L. Grossman, Yunhong Gu, Xinwei Hong, Michal Sabala, and David Handley University of Illinois of Chicago. Outline. Introduction of NCDM / LAC
E N D
The LAC/UIC experiences through JGN2/APAN during SC04 Katsushi Kouyama and Kazumi Kumazoe Kitakyushu JGNⅡ Research Center / NiCT Robert L. Grossman, Yunhong Gu, Xinwei Hong, Michal Sabala, and David Handley University of Illinois of Chicago
Outline • Introduction of NCDM / LAC • Introduction of UDT • Demos of UDT in SC2004 • Request and Comment for JGN2 / APAN on SC2004
Introduction to NCDM/LAC • NCDM: National Center for Data Mining • UIC: University of Illinois of Chicago • Standard development, Data Mining and Predictive modeling • organized into laboratories • LAC: Laboratory for Advanced Computing • LAC/UIC activities • data intensive computing • distributed computing • high performance computing and networking : UDT
TCP and AIMD • TCP has been very successful in the Internet • AIMD (Additive Increase Multiplicative Decrease) • Fair: max-min fairness • Stable: globally asynchronously stable • But, inefficient and not scalable • over high-speed wide area network • RTT bias
UDT – UDP-based Data Transfer Protocol • Application level transport protocol built above UDP • Reliable data delivery • Congestion control mechanisms • General transport API; not a (file transfer) tool. • Open source
UDT - Objectives • Goals • Easy to install and use • Efficient for bulk data transfer • Fair • Friendly to TCP • Non-goals • TCP replacement • Messaging service
Pkt. Scheduling Timer Sender Sender Sender DATA DATA Receiver Receiver ACK ACK2 ACK Timer NAK NAK Timer Retransmission Timer Rate Control Timer UDT Architecture
StarLight JGN2/APAN Abilene SURFnet Demos of UDT in SC2004 Network Configuration 10Gbps 10Gbps SC04 Amsterdam Tokyo Amsterdam Tokyo Pittsburgh (SC04)
Demos of UDT in SC2004 • Tokyo -------------- SC04 • Disk-to-Disk Transmission (1.5 Terabytes) • Sloan Digital Sky Survey (SDSS) data • Two Pair of machines • SC04 --------------- Amsterdam/Tokyo • Memory-to-Memory Transmission • Pseudo data • Parallel flows
JGN2 Link Results of Demos in SC2004 • 1.6Gbps real data file transfer between Pittsburgh and Tokyo. • 16Gbps memory data transfer in and out Pittsburgh from/to Tokyo and Amsterdam. • Winner of one of the bandwidth challenge awards • Best replacement ofFedEx / UDPfairness award
Request and Comment for usage of network on SC2004 • Introduction of the Reservation System via web (not via e-mail) • We appreciate for the strong support and cooperation during SC2004 and our on-going collaboration work.
Thank you ... Related URLs UDT Project: http://udt.sf.net NCDM: http://www.ncdm.uic.edu Kitakyushu JGNII Research Center: http://www.kyushu.jgn2.jp