1 / 15

Enabling cache for monitoring application Alexandre Beche

Enabling cache for monitoring application Alexandre Beche. Outlines. Deployment model Caching technologies + how they fit to monitoring applications Memcached Varnish Benchmark Configuration Conclusion. This presentation is not…. …A benchmark between different caching technologies.

kalona
Download Presentation

Enabling cache for monitoring application Alexandre Beche

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Enabling cache for monitoring application Alexandre Beche

  2. Outlines • Deployment model • Caching technologies + how they fit to monitoring applications • Memcached • Varnish • Benchmark • Configuration • Conclusion Alexandre Beche

  3. This presentation is not… • …A benchmark between different caching technologies. • Only two technologies has been tested: • Memcached (Backend cache) • Varnish (Frontend cache) Alexandre Beche

  4. Deployment model of monitoring applications Application DB • User request data • Using a LB alias • Request can goes on different servers • Web servers get data from the same DB Alexandre Beche

  5. Memcached memcached Application DB Alexandre Beche

  6. Memcached memcached Application DB Alexandre Beche

  7. Consistent and efficient caching memcached memcached Application DB Cache is load once per host Possible inconsistency Alexandre Beche

  8. Consistent and efficient caching memcached memcached memcached Application DB Application DB Cache is load once per cluster Data are 100% consistent Cache is load once per host Possible inconsistency Alexandre Beche

  9. Varnish Varnish Application DB Alexandre Beche

  10. Varnish Varnish Application DB Alexandre Beche

  11. Caching proxy Varnish Varnish Memcached Application DB • Less stress on server • Varnish: • Store the whole request • Memcached: • Store data from the DB • Guarantee consistency Alexandre Beche

  12. Benchmark using ab(credits to Olga) • Bench has been done for the “most popular” query • Default page • Bench specifications: • Run 100 requests • Variable number of concurrent clients (from 1 to 100) • Each request is roughly 10kB of data • Average on 100 executions has been kept • Test 3 scenarios: • Without any cache • Memcache only • Memcache + varnish Alexandre Beche

  13. Benchmark using ab(credits to Olga) 25 concurrent access max without caching Few failures when only memcached Varnish improves memcached’s performance Alexandre Beche

  14. Enabling caching • Memcached: • 0-conf: install the RPM and start the service • Comes for “free” with Django apps (decorator) • Require development effort for legacy dashboard applications (all actions need to be adapted) • Varnish: • Trivial configuration to run it on port 80 and get httpd on 8080 (or anything else) • All HTTP request will be cached Alexandre Beche

  15. Conclusion • Two main caching technologies has been tested: • Backend caching and caching proxy • Different roles • Bench are awesome but “useless”: • Monitoring apps will never have this load • Is caching useless then? NO!!! • Most popular queries can be pre-cached for allowing fast response. Alexandre Beche

More Related