1 / 23

Value Prediction

Value Prediction. Kyaw Kyaw, Min Pan. Final Project. What is Value Prediction?. Predict the value of instructions before they are executed Branch Prediction – eliminates the control dependences  Value Prediction – eliminates the data dependences. Why Value Prediction?.

brie
Download Presentation

Value Prediction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Value Prediction Kyaw Kyaw, Min Pan Final Project

  2. What is Value Prediction? • Predict the value of instructions before they are executed • Branch Prediction – eliminates the control dependences  • Value Prediction – eliminates the data dependences

  3. Why Value Prediction? • Results of many instructions can be accurately predicted before they are issued or executed. • Dependent instructions are no longer bound by the serialization constraints imposed by data dependences. • More parallelism can be explored

  4. Why Value Prediction is possible? Value Locality

  5. Why Value Prediction is possible?

  6. Causes of Value Locality • Data redundancy • Error checking • Program constants • Computed branches …… • Virtual function calls • Glue code • Addressability • Memory alias resolution

  7. Value Prediction Units Three factors determine the efficacy • Accuracy ability to avoid mispredictions • Coverage ability to predict as many instruction outcomes as possible • Scope The set of instructions that the predictor targets

  8. Relationships between factors • Accuracy ↔ Coverage trade-off • Scope • Low implementation cost • Achieve better accuracy and coverage • Mispredictions for useless predictions are eliminated

  9. Value Prediction Units • Three types • History-Based Predictors • Computational Predictors • Hybrid Predictors

  10. Value Prediction Units

  11. Example for Value Prediction Implementation

  12. Value Prediction Techniques • Last Value Predictor • Register Value Predictor • Stride 2-delta Predictor • Last Four value Predictor • Finite Context Method Predictor • Confidence Estimation

  13. Sample Research Works • “Value Locality and Load Value Prediction” M. H. Lipasti, C. B. Wilkerson, J. P. Shen ASPLOS-VII, October 1996 • “Selective Value Prediction” B. Calder, G. Reinman, D. M. Tullsen Proceedings of 26th International Symposium on Computer Architecture, May 1999

  14. Value Locality & Prediction • Likelihood of a previously-seen value recurring repeatedly within a storage location • Exists primarily due to an effective compile-time optimization

  15. Load Value Prediction • Based on Branch Prediction idea, tries to predict all 32-bit or 64-bit value • Load Value Prediction Table ~ branch target buffer • Load Classification Table ~ branch history table • Constant Verification Unit – to avoid accessing memory and force LVPT entries coherent with main memory

  16. Load Value Prediction Unit

  17. Results • PowerPC 620 = avg. 3% (max 21%) performance gain • Alpha 21164 = avg. 6% (max 17%) performance gain

  18. Selective Value Prediction • Not only on Load instructions but on all important instructions • To speculate on operations with large gains and small losses even when confidence is low, and on operations with small gains and large losses when confidence is high • To intelligently choose – • When to use value prediction • Which instructions to use value prediction

  19. Confidence Prediction • Predicted value is used if the confidence associated with that value is above given threshold. • Confidence Saturating Counter – (low, med, high) • Confidence History Counter – similar to local branch history

  20. Minimizing Capacity Misses • To prevent unnecessary replacement in the value prediction table • Replacement Counter – increment on correct prediction, decrement otherwise • Also decrement when another instruction attempts to use that entry • Warn-up Counter – increment only every time an instruction hits in the value table, set to 0 on a replacement • Only after the warn-up counter has reached a certain threshold, predictions made, confidence counter updated and VPT allowed to be modified

  21. Filtering Producers of Predicted Values • To reduce pressure on the prediction table, predict fewer instructions • Only allow entries to be allocated to instructions that define registers which are actually used by another instruction in the current instruction window • Limit the instructions that are on the critical path to be inserted into VPT

  22. Filtering Producers of Predicted Values • To reduce pressure on the prediction table, predict fewer instructions • Only allow entries to be allocated to instructions that define registers which are actually used by another instruction in the current instruction window • Limit the instructions that are on the critical path to be inserted into VPT

  23. Finding the Important Consumers • Filtering which instructions use a predicted value • Use confidence bits (low, med, high) • Path Heuristic – use predicted values for instructions that have low confidence but are on the longest path

More Related