1 / 77

Spatial Computation

This thesis explores the concept of Application-Specific Hardware (ASH) as a more scalable and efficient computation substrate than monolithic processors. It discusses compiling for ASH, media processing on ASH, and compares ASH to superscalar processors.

soniab
Download Presentation

Spatial Computation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Spatial Computation Mihai Budiu CMU CS Thesis committee: Seth Goldstein Peter Lee Todd Mowry Babak Falsafi Nevin Heintze Ph.D. Thesis defense, December 8, 2003 SCS

  2. Spatial Computation A model of general-purpose computationbased on Application-Specific Hardware. Thesis committee: Seth Goldstein Peter Lee Todd Mowry Babak Falsafi Nevin Heintze Ph.D. Thesis defense, December 8, 2003 SCS

  3. Thesis Statement Application-Specific Hardware (ASH): • can be synthesized by adapting software compilation for predicated architectures, • provides high-performance for programs withhigh ILP, with very low power consumption, • is a more scalable and efficient computation substrate than monolithic processors. not!

  4. Outline • Introduction • Compiling for ASH • Media processing on ASH • ASH vs. superscalar processors • Conclusions

  5. CPU Problems • Complexity • Power • Global Signals • Limited ILP

  6. Design Complexity from Michael Flynn’s FCRC 2003 talk

  7. Communication vs. Computation wire gate 5ps 20ps Power consumption on wires is also dominant

  8. Our Approach: ASHApplication-Specific Hardware

  9. Resource Binding Time 1. 1. Programs 2. 2. Programs CPU ASH

  10. Hardware Interface software software ISA virtual ISA gates hardware hardware CPU ASH

  11. Application-Specific Hardware C program Dataflow IR Compiler dataflow machine Reconfigurable/custom hw

  12. systems theory Contributions Computerarchitecture Embeddedsystems Reconfigurablecomputing Compilation Asynchronouscircuits High-levelsynthesis Nanotechnology Dataflowmachines

  13. Outline • Introduction • CASH: Compiling for ASH • Media processing on ASH • ASH vs. superscalar processors • Conclusions

  14. Computation = Dataflow Programs Circuits a 7 x = a & 7; ... y = x >> 2; & 2 x >> • Operations ) functional units • Variables ) wires • No interpretation

  15. Basic Operation + latch data ack valid

  16. + + + 2 3 4 + + + + latch 5 6 7 8 Asynchronous Computation + data ack valid 1

  17. FSM Distributed Control Logic ack rdy + - short, local wires asynchronous control

  18. Forward Branches b x 0 if (x > 0) y = -x; else y = b*x; * - > ! y critical path Conditionals ) Speculation

  19. p ! Split (branch) Control Flow ) Data Flow data Merge (label) data data predicate Gateway

  20. 0 i * 0 +1 < 100 sum + return sum; ! ret Loops int sum=0, i; for (i=0; i < 100; i++) sum += i*i; return sum;

  21. sequencing of side-effects no speculation Predication and Side-Effects addr token to memory Load pred data token

  22. Thesis Statement Application-Specific Hardware: • can be synthesized by adapting software compilation for predicated architectures, • provides high-performance for programs withhigh ILP, with very low power consumption, • is a more scalable and efficient computation substrate than monolithic processors. not!

  23. Outline • Introduction • CASH: Compiling for ASH • An optimization on the SIDE • Media processing on ASH • ASH vs. superscalar processors • Conclusions skip to

  24. Availability Dataflow Analysis y y = a*b; ... if (x) { ... ... = a*b; }

  25. Dataflow Analysis Is Conservative if (x) { ... y = a*b; } ... ... = a*b; y?

  26. Static Instantiation, Dynamic Evaluation flag = false; if (x) { ... y = a*b; flag = true; } ... ... = flag ? y : a*b;

  27. SIDE Register Promotion Impact Loads % reduction Stores

  28. Outline • Introduction • CASH: Compiling for ASH • Media processing on ASH • ASH vs. superscalar processors • Conclusions

  29. Performance Evaluation Mem L2 1/4M ASH L1 8K LSQ limited BW CPU: 4-way OOO Assumption: all operations have the same latency.

  30. Media Kernels, vs 4-way OOO

  31. Media Kernels, IPC

  32. Speed-up / IPC Correlation

  33. Low-Level Evaluation C CASHcore Results shown so far. All results in thesis. Verilog back-end Synopsys,Cadence P/R 180nm std. cell library, 2V ~1999 technology Results in the next two slides. ASIC

  34. Area Reference: P4 in 180nm has 217mm2

  35. Power vs 4-way OOO superscalar, 600 Mhz, with clock gating (Wattch), ~ 6W

  36. Thesis Statement Application-Specific Hardware: • can be synthesized by adapting software compilation for predicated architectures, • provides high-performance for programs withhigh ILP, with very low power consumption, • is a more scalable and efficient computation substrate than monolithic processors. not!

  37. Outline • Introduction • CASH: Compiling for ASH • Media processing on ASH • dataflow pipelining • ASH vs. superscalar processors • Conclusions skip to

  38. i 1 Pipelining + * 100 <= int sum=0, i; for (i=0; i < 100; i++) sum += i*i; return sum; pipelined multiplier (8 stages) sum + cycle=1

  39. i 1 Pipelining + * 100 <= sum + cycle=2

  40. i 1 Pipelining + * 100 <= sum + cycle=3

  41. i 1 Pipelining + * 100 <= sum + cycle=4

  42. i 1 Pipelining + i=1 100 <= i=0 sum + cycle=5 pipeline balancing

  43. Outline • Introduction • CASH: Compiling for ASH • Media processing on ASH • ASH vs. superscalar processors • Conclusions

  44. wrong! This Is Obvious! ASH runs at full dataflow speed, so CPU cannot do any better(if compilers equally good).

  45. SpecInt95, ASH vs 4-way OOO

  46. ASH crit path CPU crit path Predicted not taken Effectively a noop for CPU! result available before inputs Predicted taken. Branch Prediction i 1 + for (i=0; i < N; i++) { ... if (exception) break; } < exception ! &

  47. SpecInt95, perfect prediction

  48. ASH Problems • Both branch and join not free • Static dataflow(no re-issue of same instr) • Memory is “far” • Fully static • No branch prediction • No dynamic unrolling • No register renaming • Calls/returns not lenient • ...

  49. Thesis Statement Application-Specific Hardware: • can be synthesized by adapting software compilation for predicated architectures, • provides high-performance for programs withhigh ILP, with very low power consumption, • is a more scalable and efficient computation substrate than monolithic processors. not!

  50. Outline Introduction • CASH: Compiling for ASH • Media processing on ASH • ASH vs. superscalar processors • Conclusions

More Related