70 likes | 155 Views
A Metrics System for Continuous Improvement of Design Technology. Andrew B. Kahng and Stefanus Mantik. Current Status. Complete prototype of METRICS with industry standard components (Oracle, Java, XML, HTML, etc.)
E N D
A Metrics System for Continuous Improvement of Design Technology Andrew B. Kahng and Stefanus Mantik
Current Status • Complete prototype of METRICS with industry standard components (Oracle, Java, XML, HTML, etc.) • Metricized Place and Route runs on 100+ designs, seeking access to Synopsys regression suite data • Complete metricization of Cadence system-level timing flow • Metricization of synthesis and verilog simulation tools • Initial feedback from industry on METRICS standards • Attempting to spec Intel requirements for METRICS system
COM-Based Alternative • EDA tools: • provide COM interface for capturing internal information • add information collections (“counters”) inside the tools • METRICS transmitter: • get information via the COM interface • format the data in XML, encrypt the message, and send it to the server • Benefit: • allow independent development for transmitter and tools
Current Results • CPU_TIME = 12 + 0.027 NUM_CELLS (correlation = 0.93) • More plots are accessible at http://xenon.cs.ucla.edu:8080/metrics
Data Mining Results Cubist [Release 1.07] Sun Jun 4 02:56:59 2000 Target attribute `CPU_TIME' Read 200 cases (98 attributes) from 2.data Model: • Rule 1: [101 cases, mean 334.3, range 64 to 3881, est err 276.3] if ROW_UTILIZATION <= 76.15 then CPU_TIME = -249 + 6.7 ROW_UTILIZATION + 55 NUM_ROUTING_LAYER - 14 NUM_LAYER • Rule 2: [168 cases, mean 365.7, range 20 to 5352, est err 281.6] if NUM_ROUTING_LAYER <= 4 then CPU_TIME = -1153 + 192 NUM_ROUTING_LAYER + 12.9 ROW_UTILIZATION - 49 NUM_LAYER • Rule 3: [16 cases, mean 795.8, range 126 to 1509, est err 1069.4] if NUM_ROUTING_LAYER > 4 and ROW_UTILIZATION > 76.15 then CPU_TIME = -33 + 8.2 ROW_UTILIZATION + 55 NUM_ROUTING_LAYER - 14 NUM_LAYER Evaluation on training data (200 cases): Evaluation on test data (200 cases): Average |error| 275.0 Average |error| 852.3 Relative |error| 0.78 Relative |error| 0.96 Correlation coefficient 0.20 Correlation coefficient 0.30
Ongoing Works • DAC-2000 Birds-of-a-Feather meeting • present and obtain feedback on existing METRICS infrastructure • solicit participation in a standardization effort for open-source METRICS infrastructure • establish a community to realize METRICS, design process optimization, and the associated growth opportunities for EDA tools and design services industries • Add installation scripts • ease the setup for the METRICS system on any design house • integrate the METRICS system with available tools • Provide the ability to interact with COM interface
DAC 00 Birds of a Feather Attendees • Bill Bell, Texas Instrument • Andy Brotman, Director, Custom Design Automation, Conexant Systems Inc. • Mojy C. Chian, Conexant Systems Inc. • Dan Clein, PMC-Sierra • Thomas Harms, SoCDT - Marketing & Applications Europe, Motorola • Shannon Johnston, Senior Manager, Microelectronics IP, Nortel Networks • Jeff Jussel, Director of Strategic Marketing and Business Development, Mentor Graphics • Thomas Kropf, Robert Bosch GmbH • Brian Lambert, Design Flow Methodology Manager, Philips • Anil Mankar, Director, Hardware Systems Engineering, Conexant Systems, Inc. • Tom Moxon, Sr. Director, Design Methodology, Toolwire, Inc.