Andy Gean Ye University of Toronto

1. Field-programmable Gate Array Architectures and Algorithms Optimized for Implementing Datapath Circuits Andy Gean YeUniversity of Toronto

2. Motivation: Datapath Regularity • Larger FPGAs • Larger applications on FPGAs • More datapath logic in larger applications • Datapath logic is highly regular • In custom ASIC regularity is routinely utilized to increase logic density • Can regularity also be utilized to improve the logic density of FPGAs?

3. Previous Work • Datapath-FPGA (DP-FPGA) study [cher96] • Yes, datapath regularity can be utilized to reduce FPGA area by as much as 50% • Based on a partially specified FPGA architecture • Major simplifying assumptions • All transistors are minimum width • Datapaths are completely regular • No inefficiency from the CAD tools

4. This Work – An In-depth Study on Datapath Regularity • Designed a new datapath-oriented FPGA architecture • With detailed architectural specifications • With correctly sized transistors • Utilized realistic datapath benchmarks • From the Pico-java processor from SUN • Created a complete set of CAD tools to support the new architecture • Taking CAD inefficiency into account

5. Multi-bit FPGA (MB-FPGA) • Architected to utilize datapath regularity to generate area savings • Architectural features • Capture regularity using special logic blocks called super-clusters • Increase logic density through configuration memory sharing routing resources

6. L L L L S L Switch Block Logic Block Conf. Mem. Shar. Routing Tracks Conventional Routing Tracks MB-FPGA – Overview Routing Channels S

7. LRN BLE LRN BLE LRN BLE LRN BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE Local Routing Network BLE MUX LUT BLE DFF BLE M BLE A Basic Logic Element (BLE) Cluster = Bit-Slice MB-FPGA – Logic Block Cluster 1 Cluster 2 Cluster 3 Cluster 4

8. Capturing Datapath Regularity BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE BLE Bit-Slice 1 Bit-Slice 2 Bit-Slice 3

9. Logic Block Cluster Cluster Cluster Cluster M Switch Block M M M M M M Conventional Routing Conf. Mem. Shar. Routing MB-FPGA – Routing Architecture

10. L L L L M Utilizing Datapath Regularity to Save Area Conf. Mem. Shar. Tracks

11. Area Estimation Using Correct Transistor Sizing • Based on the fully specified MB-FPGA architecture • Detailed Assumptions • SRAM transistors are min. width • Tri-state buffers are 5x min. width • 75% FPGA area is routing area • Simplified Assumptions • Datapaths are completely regular (all conf. mem. shar. tracks) • No inefficiency from the CAD tools

12. Area Estimation Using Correct Transistor Sizing • Datapath regularity can only be used to reduce the MB-FPGA area by 25% • Down from the 50% area savings prediction of the DP-FPGA study [cher96]

13. Benchmark Regularity • Fifteen benchmark circuits • From the Pico-java processor • Implemented on the MB-FPGA • Measurements after synthesis • Logic regularity • Net regularity

14. Logic Regularity • Classify LUTs and DFFs into two types • Irregular type • LUTs and DFFs that do not belong to any 4-bit wide datapath components • Regular type • LUTs or DFFs that belong to a 4-bit wide datapath component • More regular type of LUTs and DFFs • More regular nets • Greater area savings

15. S4 S3 S2 S1 A Datapath Component A Datapath Component – A Group of 4 identical LUTs or DFFs Identical LUTs or DFFs

16. Logic Regularity

17. Net Regularity • Classify two-terminal connections in each circuit into three types • Regular 4-bit wide buses • Regular 4-bit wide control group • Irregular • Two-terminal connections do not belong to either a bus or a control group

18. S4 S4 S4 S3 S3 S3 S2 S2 S2 S1 S1 S1 Definition – Net Regularity A 4-bit wide bus A 4-bit wide control group Note: Only 4-bit wide buses can be used to increase the area efficiency of MB-FPGA through conf. mem. shar. routing tracks

19. Net Regularity

20. Area Estimation Based on Correct Net Regularity • Assumptions • SRAM transistors are min. width • Tri-state buffers are 5x min. width • 75% FPGA area is routing area • 50% of routing tracks are conf. mem. shar. • No inefficiency from the CAD tools • Result • Datapath regularity can be utilized to reduce FPGA area by 12% (again down from 25%)

21. Datapath-oriented CAD Flow – Overview Enhanced Module Compaction Synthesis Coarse-grain Node Graph Packing Multi-bit FPGA Placement Coarse-grain Resource Routing

22. Can Regularity Be Utilized to Improve Logic Density? • To achieve best area • What should be the best number of clusters per logic block? • What should be the best number of conf. mem. shar. routing tracks per routing channel? • What is the performance this datapath-oriented FPGA?

23. Experiments • Fifteen benchmark circuits • From the Pico-java processor • Implemented on the MB-FPGA • Experiments • Granularity (the number of clusters per logic block) vs. Area • % conf. mem. shar. tracks vs. area • % conf. mem. shar. tracks vs. performance

24. Granularity Vs. Area • Explored a 2-D architectural space • First vary granularity • For each granularity: vary % of conf. mem. shar. routing tracks per routing channel • For each architecture, find the average area required to implement the benchmark circuits • Plot best area for each granularity

25. Granularity Vs. Area

26. % C.M.S. Tracks Vs. Area • Assume four clusters per logic block for the MB-FPGA • For each circuit • Set a fixed number of conf. mem. shar. tracks • Search for minimum number of additional conv. tracks • Classify into eight percentile ranges • Use the minimum area obtainable for each circuit to calculate average area

27. % C.M.S. Tracks Vs. Area • Also implement the same benchmarks on a comparable conventional FPGA • MB-FPGA area is normalized against the conventional FPGA area

28. % C.M.S. Tracks Vs. Area Normalized Avg. Area 10% % Conf. Mem. Shar. Tracks

29. Area (40% - 50% Tracks Are C.M.S.)

30. Performance (Crit. Path Delay) • Assume carry network delay equal to local routing network delay • Over-estimated carry delay • Results are pessimistic • Normalized average crit. path delay over 15 benchmark circuits with respect to conventional FPGA

31. % C.M.S. Tracks Vs. Crit. Path Normalized Avg. Delay

32. Crit. Path Delay (40%- 50% Tracks Are CMS)

33. Conclusions • Investigated the question • Can regularity be effectively utilized to improve logic density? • Presented • A datapath-oriented FPGA architecture • Fully specified to the level of transistor sizing • An analysis on datapath regularity • A brief description of the CAD flow for the architecture

34. Conclusions • Detailed architectural specification and CAD implementation is very important • Best MB-FPGA architecture • Granularity = 4 • 40%-50% of tracks are C.M.S. • Architectural Results • 10% smaller in area than conv. FPGA • Much less than the 50% area savings prediction [cher96] • Has a 10% performance penalty

35. Discussions • Under what circumstances will MB-FPGA be more area efficient? • Applications with more buses than our benchmarks • Wider datapath applications • Larger than 1x min. width transistors in SRAM cells • Smaller than 5x min. width transistors in tri-state buffers • SRAM reduction is more important than area reduction

36. Future Work • Architecture • Sharing configuration memory in logic • Improve performance • CAD tools • Proper modeling of carry network delay • Improve performance • Power modeling

37. Detailed Datapath-oriented CAD Implementation Issues Andy Gean YeUniversity of Toronto

38. Datapath-oriented CAD Flow – Overview Enhanced Module Compaction Synthesis Coarse-grain Node Graph Packing Multi-bit FPGA Placement Coarse-grain Resource Routing

39. Input to CAD Flow • Netlists of datapath components in Verilog or VHDL • From a pre-defined library • Arithmetic operators • Logic operators • Multiplexers • Datapath regularity of the input is preserved throughout the CAD flow

40. An Example Input Datapath Circuit a0 b0 a1 b1 a2 b2 a3 b3 sel mux mux mux mux c0 c1 c2 c3 d0 d1 d2 d3 cout cin + + + + s0 s1 s2 s3

41. Synthesis • Synopsys FPGA compiler has 38% area inflation when instructed to preserve datapath regularity • Two major causes of area inflation • Duplicated logic across bit-slices • Bit-slices are too small • Augmented FPGA compiler with new algorithms • Reduced the area inflation to 3%

42. Packing • Based on the T-VPACK [betz99] algorithm • Like T-VPACK – timing driven • New feature – ability to preserve datapath regularity

43. a1 a3 a2 a0 b1 b3 b2 b0 c0 c3 c1 c2 sel sel sel sel After Synthesis and Packing BLE BLE BLE BLE bus d0 cin d1 d2 d3 BLE BLE BLE BLE BLE BLE BLE BLE s0 s1 s2 s3 cout

44. Placement and Routing • Based on the VPR tools [betz99] • Placer: simulated annealing [kirk83] • Router: congestion negotiation-based pathfinder [ebel95] • New feature of the placer • Ability to move individual clusters if they do not contain datapath • Move entire logic block if they contain datapath to preserve datapath regularity

45. Router • Contains a new set of expansion cost functions • Designed to ease the task of comparing the cost of using conv. tracks against the cost of using conf. mem. shar. tracks • Composed of delay and congestion metrics (similar to the conventional expansion cost)

46. Overall Routing Flow Route Buses Route Non-bus Signals Update Cost Functions

47. Routing Buses • Route entire buses through conf. mem. shar. routing tracks • Route the first bit through conv. routing tracks – test for delay and congestion • Compare expansion costs • Select the option with the lowest expansion cost

48. Routing Non-bus Signals • Consider the options of routing the signal through conv. as well as conf. mem. shar. tracks • Compare the expansion cost • Select the option with the lowest expansion cost