1 / 20

Cache performance

Cache performance. CS 147 Prof. Lee Hai Lin Wu. Cache performance. Introduction Primary components Cache hits Hit ratio Cache misses Average memory access time. Why we use cache memory in a computer?. The primary reason:

selma-holland
Download Presentation

Cache performance

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Cache performance CS 147 Prof. Lee Hai Lin Wu

  2. Cache performance • Introduction • Primary components • Cache hits • Hit ratio • Cache misses • Average memory access time

  3. Why we use cache memory in a computer? The primary reason: to improve system performance by reducing the time needed to access memory.

  4. Cache hits • Definition • Every time the CPU accesses memory, it checks the cache. If the requested data is in the cache, the CPU accesses the data in the cache, rather than physical memory; this is a cache hit.

  5. A simple example Every time CPU access memory it checks cache first. CPU checkaccessesdata (not in cache) Physical memory cache

  6. Cache misses • Definition: • If the data is not in the cache, the CPU accesses the data from main memory(and usually writes the data into the cache as well). This is a cache miss.

  7. Hit ratio • Definition: • The hit ratio is the percentage of memory accesses that are served from the cache. Hit Ratio = #of hits / total Strings

  8. Average Memory access time • Symbol: TM

  9. Formula for TM • TM = hTc + (1 – h) Tp *Tc – cache access time *Tp – physical memory access time *h -- hit ratio (Note: Tc and Tp are always given)

  10. Relationship between Hit ratios and Average memory access times • Table: So, increase the hit ratio reduce the average memory access time.

  11. Calculating the H and TM • We will learn how to calculate the H and TM with two different type of cache * associative cache (FIFO) * two-way set-associative cache(LRU) • Besides, there is a direct mapped cache

  12. Example of associative cache (FIFO)

  13. Example cont. Given: Tc = 10ns Tp = 60ns From the previous table we get: hits = 7 inputs = 18 ** h(hit ratio)= hits/ inputs = 7/18 = 0.389 ** TM = h Tc + (1 – h) Tp =0.89*10 + (1 - 0.389) 60 = 40.56 ns

  14. Two-way associative set- associative cache(LRU) • Hit ratio h = 0.389 • TM = 40.56 ns

  15. A simple example for LRU • Since the example from book is kind of hard to understand, we can see the following simple example.

  16. Simple example of LRU • 3 frame • 10 inputs: 1, 2, 3, 0, 2, 3, 1, 3, 0, 4

  17. Construct a table • Table

  18. Direct mapped cache • The hit ratio h = 0.167 • The TM = 50.67 ns

  19. The End!!

  20. BUT… You have to remember • How to set up the table for FIFO and LRU • How to calculate • Hit Ratio • Average memory access time Gook luck on finals!!

More Related