Phoenix: Towards an Accurate, Practical and Decentralized Network Coordinate System

1. Phoenix: Towards an Accurate, Practical and Decentralized Network Coordinate System Yang Chen1, Xiao Wang1, Xiaoxiao Song1, Eng Keong Lua2, Cong Shi3, Xiaohan Zhao1, Beixing Deng1, Xing Li1 1Department of Electronic Engineering, Tsinghua University, Beijing 100084, China 2 College of Engineering, Carnegie Mellon University, Pittsburgh, PA 15213 3 College of Computing, Georgia Institute of Technology, Atlanta, GA 30332

2. Outline • Introduction • Related Work • Design of Phoenix • Performance Evaluation • Conclusion

3. Introduction • Problem • Distance (Latency) information is very important in Internet applications: Server Selection, Overlay Construction, Overlay Multicast, Overlay Routing, Application Layer Anycast • Direct measurement: Bad scalability • Network Coordinate (NC) System • Scalable way for Internet distance prediction • Use O(N) measurement to predict the distances of N2 end-to-end links

4. Related Work • Euclidean Distance based Network Coordinates and Triangle Inequality Violation (TIV) • Dot Product based NC and IDES

5. Euclidean Distance based NC • Euclidean distance based NC is an embedding of N hosts into d-dimensional Euclidean space Rd • Typical NC systems • GNP,Vivaldi,PIC,NPS… d=3

6. Triangle Inequality Violation (TIV) D(A,C)+D(C,B)<D(A, B) DE(A,C)+DE(C,B)>DE(A, B) Any three hosts with TIV cannot be embedded into Euclidean space within some level of accuracy, for the distances among them in Euclidean space must obey triangle inequality.

7. Dot Product based NC DE(A,C)+DE(C,B)>DE(A, B) tolerate the constraints of TIVs.

8. IDES • First dot product based NC system • Problems • Negative Distance • Fair Prediction Accuracy

9. Negative Distance in IDES • Cause the malfunction of the system because the distance (Round Trip Time) can not be negative.

10. Fair Prediction Accuracy • Reason: Error Propagation • A certain host gives equal confidence to each referred NC • However, some NCs are very inaccurate due to different factors Prediction Accuracy: No better than GNP/Vivaldi/…!!

11. Design Goal of Phoenix • Accurate • Dot Product based NC • Weighted Model • Decentralized • Practical • Never give negative predicted distance

12. Architecture of Phoenix • Early Hosts • Ordinary Hosts

13. Early Hosts • If N ≤ m, the new host Hnew will be considered as one of the early hosts. • These early hosts will probe each other to obtain the N × N distance matrix • The system will use NMF (Non-negative Matrix Factorization) algorithm to get the NCs (incoming vectors and the outgoing vectors) of these early hosts.

14. Ordinary Hosts • N>m • For each new host Hnew • select any m existing hosts randomly • Hnew measures its RTTs to these m hosts as well as retrieves the NCs (Xnew and Ynew)of these m hosts. • NC can be calculated and updated periodically.

15. NC Calculation of Ordinary Hosts • Calculation of Xnew and Ynew • Predicted Distance between Hnew and Ri Different weights are assigned to each referred vectors

16. Weight Calculation The more accurate the referred vector is, the higher confidence (weight) should be given to this NC. In contrast, some referred vectors with abnormal high error will not be considered for NC calculation. C is set as 5 in our Phoenix implementation.

17. Performance Evaluation • Setup of the Experiment • Metrics • Evaluation Results on Prediction Accuracy • Convergence Behavior of Phoenix • Robustness over Measurement Anomalies

18. Setup of the Experiment • All of these three systems use 10-dimensional coordinates. • Phoenix: each host has m reference hosts • IDES: m randomly selected landmarks • Vivaldi: each host has m neighbors. (cc=0.25,ce=0.25) • m=32 • 10 runs are performed on each data set and the average results are reported.

19. Datasets

20. Metrics • Relative Error (RE) • Smaller RE indicates higher prediction accuracy. When measured distance equals to predicted distance, the RE value will be zero. • More attention is paid to the 90th Percentile Relative Error (NPRE) since it can guarantee 90% of the hosts have lower RE values than it

21. Prediction Accuracy • Compared with Vivaldi, the representative Euclidean distance based NC, Phoenix can reduce the NPRE by between 18.34% (P2PSim data set) and 52.17% (AMP data set). • Our simulation results demonstrate that Phoenix can achieve high prediction accuracy in a decentralized and practical way.

22. Convergence Behavior of Phoenix • Basically, Phoenix will converge in less than 10 rounds. • the final median prediction error of Phoenix is about 31% smaller than Vivaldi. Therefore the convergence of Phoenix is very fast and effective.

23. Robustness over Measurement Anomalies • Phoenix is very robust to small amount of measurements anomalies. • The difference between Phoenix and Phoenix(Simple) demonstrates that the weighted model can eliminate the impact of measurement anomalies greatly.

24. Conclusion • Phoenix achieves much higher prediction accuracy than state-of-the-art NC systems in different typical Internet data sets • Phoenix is an accurate, practical and decentralized solution to scalable Internet distance prediction.

25. Download the Simulator • http://www.net-glyph.org/~chenyang/Phoenix-sim.zip

26. Phoenix: Towards an Accurate, Practical andDecentralized Network Coordinate System