1 / 12

OS Interaction with Cache Memories

Dive into the fascinating world of CPU cache memories with Dr. Sohum Sohoni from Oklahoma State University. Discover terminology, future predictions, and the impact of multitasking on cache performance. Learn how prefetching can optimize memory access and improve system efficiency.

santanaj
Download Presentation

OS Interaction with Cache Memories

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OS Interaction with Cache Memories Dr. SohumSohoni School of Electrical and ComputerEngineering Oklahoma StateUniversity

  2. Outline • Technically ‘light’ talk- broad audience • Background terminology and one example of current work • Wild predictions about the future • ManythankstotheNationalScienceFoundationCNS #0720741 • Anyviewspresentedhere are myown, and notreflective of theNSF’sviews and policies

  3. Some Terminology • CPU Caches • Miss rates • Locality • Prefetching • Context Switches • ‘state’ • Working set or memory footprint • Process queue

  4. Goal of Memory Hierarchy • Low latency, high bandwidth, high capacity, low cost 300 cycles 2+7 = 9 cycles Main Memory (System DRAM) 3GHz 2 cycles L2 Cache L1 Cache CPU 16 KB 512 KB Extremely fast bus Slower bus Much slower bus 512 MB

  5. What Happens in a Context Switch • Current process ‘state’ is saved • Scheduler is invoked • Next process is ‘brought in’ • TLB’s are flushed • L1 cache may be flushed • New process executes for its time slice • Interrupt, state saved, scheduler … • Effective locality gets wiped out

  6. Effect of MultiProgramming Memorypressure CPU I/O CPU I/O CPU CPU I/O CPU 10ms 20ms 30ms 40ms 50ms 60ms Memorypressure CPU CPU CPU CPU CPU CPU CPU CPU CPU I/O I/O I/O 10ms 20ms 30ms 40ms 50ms 60ms

  7. Problem with MultiProgramming • Increasing multi-programming increases cache miss rates • Loss of locality of reference • Diminishing returns from multi-programming • Eventual thrashing k

  8. Out of Context Prefetching • Reduce thenegativeeffect of multi-programmingon CPU cache performance • Predictfuturecontextswitches • Prefetchtheworking set of thenextprocess Context Switch! Prefetch Memory Pressure Time

  9. OOC Prefetching Picture Main memory L2 OOC Prefetch L1 CPU

  10. Context Switch Prediction

  11. Miss Rate Improvement

  12. Thank you!Q and A

More Related