1 / 41

Comparing, Tracing and Evaluating Caching Servers

Comparing, Tracing and Evaluating Caching Servers. Presenter: Yi-Hsiang Lin Advisor: Dr. Ying-Dar Lin High-Speed Network Lab. of CIS, NCTU Oct 25, 2001. OUTLINE. Introduction Market review Squid: The open source solution Benchmarking squid Conclusions Reference. 1. Introduction.

brandy
Download Presentation

Comparing, Tracing and Evaluating Caching Servers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Comparing, Tracing and Evaluating Caching Servers Presenter: Yi-Hsiang Lin Advisor: Dr. Ying-Dar Lin High-Speed Network Lab. of CIS, NCTUOct 25, 2001

  2. OUTLINE • Introduction • Market review • Squid: The open source solution • Benchmarking squid • Conclusions Reference High-Speed Networks Lab, CIS, NCTU

  3. 1. Introduction • Why caching? Where to cache? • Major issues in caching (research papers) • Products/packages survey • squid (brief review) High-Speed Networks Lab, CIS, NCTU

  4. Why caching? Where to cache? Why caching? • Reduced network bandwidth or offload web server • Faster Response to End User Increased Network Scalability Where to cache? • Client side  forward caching • Server side  reverse caching • Network  transparent caching High-Speed Networks Lab, CIS, NCTU

  5. Forward caching High-Speed Networks Lab, CIS, NCTU

  6. Reverse caching High-Speed Networks Lab, CIS, NCTU

  7. Transparent caching High-Speed Networks Lab, CIS, NCTU

  8. Major issues in caching • About traffic and performanceOrigin Server Performance and CharacterizationProxy Cache Traffic CharacterizationUser Perception of Web PerformanceWeb Client Traffic Characterization • About cache contentWeb Cache Consistency Web Cache Replacement HTTP Inter-cache Communication Prefetching • Other issues and politics High-Speed Networks Lab, CIS, NCTU

  9. Products/packages survey(1/2) High-Speed Networks Lab, CIS, NCTU

  10. Products/packages survey(2/2) High-Speed Networks Lab, CIS, NCTU

  11. Squid is • a full-featured Web proxy cache • designed to run on Unix systems • free, open-source software • the result of many contributions by unpaid (and paid) volunteers • licensed under the terms of the GNU General Public License High-Speed Networks Lab, CIS, NCTU

  12. Squid supports • Cache content: 1. proxying and caching of HTTP, FTP, and other URL's 2. proxying for SSL 3. caching of DNS lookups • Cache mechanism: 1. cache hierarchies, Cache Digests 2. ICP, HTCP, CARP, WCCP 3. transparent caching 4. HTTP server acceleration • Extra services: extensive access controls, SNMP High-Speed Networks Lab, CIS, NCTU

  13. 2. Market review • Products/packages comparison • Benchmark survey1. Benchmark items2. Benchmark results3. Observations/conclusions High-Speed Networks Lab, CIS, NCTU

  14. Products/packages comparison High-Speed Networks Lab, CIS, NCTU

  15. Benchmark items • Total price • Peak Throughput • Cache Age(hour) • Response times(Hit/All/Miss) • Saving(Doc/Time) • $1000 can buy(hit/sec, req/sec) • Minutes Till First(Miss/Hit) High-Speed Networks Lab, CIS, NCTU

  16. Benchmark results(1/2) High-Speed Networks Lab, CIS, NCTU

  17. Benchmark results(2/2) High-Speed Networks Lab, CIS, NCTU

  18. Observations/conclusions • IBM-230Best: hit response time  use gigabit NICworst: average response time, Saving(DOC), cache age  Peak throughput, less disk space • Lucent-50Best: average response time, Saving(Time), minutes till First  low throughput, big cacheworst: Throughput, $1000 can buy high price • Bigger Memory and High-speed network card are important for caching server High-Speed Networks Lab, CIS, NCTU

  19. 3. squid: The open source solution • Overview • Configration example • Protocols (ICP, HTTP, etc.) • Program architecture • Data structures • Flowcharts High-Speed Networks Lab, CIS, NCTU

  20. Overview • Squid is derived from the ARPA-funded Harvest project • Squid is a high-performance proxy caching server for web clients • Squid handles all requests in a single, non-blocking, I/O-driven process High-Speed Networks Lab, CIS, NCTU

  21. Example(1) TANet proxy High-Speed Networks Lab, CIS, NCTU

  22. Example(2) Transparent High-Speed Networks Lab, CIS, NCTU

  23. Protocols • Supporting FTP, gopher, and HTTP data objects. • caches DNS lookups, supports non-blocking DNS lookups, and implements negative caching of failed requests. • Squid supports SSL, extensive access controls, and full request logging. • using the lightweight Internet Cache Protocol High-Speed Networks Lab, CIS, NCTU

  24. Data structures High-Speed Networks Lab, CIS, NCTU

  25. Flowcharts High-Speed Networks Lab, CIS, NCTU

  26. Flowcharts High-Speed Networks Lab, CIS, NCTU

  27. 4. Benchmarking squid • Previous test results on squid • Benchmark methodologies test items, tools, etc. • Benchmark results High-Speed Networks Lab, CIS, NCTU

  28. Previous test results(1/2)About cache size High-Speed Networks Lab, CIS, NCTU

  29. Previous test results(2/2)About library, algorithm High-Speed Networks Lab, CIS, NCTU

  30. Benchmark methodologies • Use polymix-1 of polygraph 2.5.5 • Change request rate(30/60/90/180) • Install FreeBSD/Linux/Solaris on three disk • Two cache diskcache size 500x2MB High-Speed Networks Lab, CIS, NCTU

  31. Benchmark flowchart High-Speed Networks Lab, CIS, NCTU

  32. Benchmark results(1/5)Hit response times(msec) High-Speed Networks Lab, CIS, NCTU

  33. Benchmark results(2/5)Miss response times(msec) High-Speed Networks Lab, CIS, NCTU

  34. Benchmark results(3/5)Avg. response times(msec) High-Speed Networks Lab, CIS, NCTU

  35. Benchmark results(4/5)Hit ratio(%) High-Speed Networks Lab, CIS, NCTU

  36. Benchmark results(5/5)Comparison of three OS High-Speed Networks Lab, CIS, NCTU

  37. 5. Conclusions • Good for caching1. Big memory cache space and high-speed network2. Use the best disk access methods for the OS • Best choice of squidFreeBSD+DISKD(570 req/sec, avg. response time 6.4 sec) • Squid is good enough for TANet traffic using. High-Speed Networks Lab, CIS, NCTU

  38. Reference(1/4) [1] Squid Internet Object Cache: <http://www.squid-cache.org> [2] The FreeBSD Project: <http://www.freebsd.org> [3] Linux:<http://www.linux.org>, Linux.com – A Means to World Liberation<http://www.linux.com> [4] Solaris product line: <http://www.sun.com/software/solaris/> [5] Web Caching-related Papers and Articles: <http://www.web-cache.com/Writings/papers.html> [6] Web Caching Products and Software: <http://www.web-cache.com/products.html> [7] D. Wessels and K. Claffy National Laboratory for Applied Network Research/UCSD, Internet Cache Protocol version 2, RFC 2186, September 1997 [8] P. Vixie(ISC), D. Wessels(NLANR), Hyper Text Caching Protocol, RFC 2756, January 2000 High-Speed Networks Lab, CIS, NCTU

  39. Reference(2/4) [9] CARP, Cache Array Routing Protocol. Internet Draft draft-vinod-carp-v1-03.txt(expired) [10] WCCP, Web Cache Coordination Protocol. draft-wilson-wrec-wccp-v2-00.txt(expired) [11] Ara Network Technologies: <http://www.aranetwork.com/eng/products/web.htm> [12] CacheFlow cIQ Content Delivery: <http://www.cacheflow.com/products/index.cfm/> [13] Cisco Cache Engine Series: <http://www.cisco.com/warp/public/cc/pd/cxsr/500/> [14] Compaq TaskSmart C-series: <http://www.compaq.com/tasksmart/c4000/index.html> [15] TMF(The Measurement Factory INC.): <http://www.measurement-factory.com> High-Speed Networks Lab, CIS, NCTU

  40. Reference(3/4) [16] A. Rousskov and D. Wessels, The Third Cache-off. Raw data and independent analysis at <http://www.measurement-factory.com/results/>. [17] ARPA(Advanced Research Projects Agency): Now called Defense Advanced Research Projects Agency (DARPA), the U.S. government agency that funded the ARPANET [18] Harvest Project: <http://harvest.cs.colorado.edu/> [19] 參閱下列網站：臺灣大學網路快取服務<http://procy.ntu.edu.tw>、中央大學網路代理伺服器<http://proxy.ncu.edu.tw>、交大網路快取服務<http://proxy.nctu.edu.tw>、新竹師院快取伺服器<http://proxy.nhctc.edu.tw>、中華大學網路快取服務<http://proxy.chu.edu.tw>、中正大學網路快取服務<http://proxy.ccu.edu.tw>、成功大學網路快取服務< http://proxy.ncku.edu.tw/>、中山大學代理伺服器< http://proxy.nsysu.edu.tw>、、、等 High-Speed Networks Lab, CIS, NCTU

  41. Reference(4/4) [20] The CodeRed Worm: CERT<http://www.cert.org> Incident Note IN-2001-09,13,19,23 [21] Squid Programmers Guide, Chapter 2 Overview of Squid Components, <http://www.squid-cache.org/Doc/Prog-Guide/prog-guide-2.html> [22] ] Squid Programmers Guide, Chapter 4 Flow of a Typical Request, <http://www.squid-cache.org/Doc/Prog-Guide/prog-guide-4.html> [23] Web PolyGraph: <http://www.web-polygraph.org/> [24] 臺灣大學網路快取服務系統配備及使用統計: <http://proxy.ntu.edu.tw/ntu-proxy/stats.html> [25] 交大網路快取服務伺服器流量統計: <http://proxy.nctu.edu.tw/proxy/log.html> [26] 國立中山大學代理伺服器首頁: <http://proxy.nsysu.edu.tw> High-Speed Networks Lab, CIS, NCTU

More Related