190 likes | 259 Views
Data & Analytics Applied to Test Strategy. Brad Waggle. Board Test Workshop. September 9th, 2014. Here in Texas, everything’s big, so we just call it data. Michael Dell … http://www.dell.com/learn/us/en/19/power/ps2q14-20140230-michael. Agenda. Context Data usage behavior shift
E N D
Data & AnalyticsApplied to Test Strategy Brad Waggle Board Test Workshop September 9th, 2014
Here in Texas, everything’s big, so we just call it data. Michael Dell … http://www.dell.com/learn/us/en/19/power/ps2q14-20140230-michael
Agenda • Context • Data usage behavior shift • Facilitating the shift • Technology Stack • What can we do now that we couldn’t do before? • What can’t we do yet but are working on?
Context • Test / Supply Chain Complexity • 1000s of testers, 10’s-of-thousands of product IDs, 100’s of thousands of component part numbers • Billions and Billions of rows of data (over years and years) • Test and Repair • 6.1B • Measurement • 45.5B • Component • 65.8B • And GROWING FAST!
Data usage behavior shift • In the past • Small product sample • Short time frame • Solve point problems • Lack of learning • Going Forward • All products (n = all) • All time frames • Solve strategic problems • Learn and prevent problems
Facilitating the shift • Migrating from: • Excel based aggregation / manipulation • Limited custom web pages • IT driven support model • Traditional database architecture • To: • Best in class front-end analytics (Spotfire) • User driven support model / self-service • Big data architecture Test Repair Qualification Field Product Cost Component
Facilitating the shift • Migrating from: • Excel based aggregation / manipulation • Limited custom web pages • IT driven support model • Traditional database architecture • To: • Best in class front-end analytics (Spotfire) • User driven support model / self-service • Big data architecture Test Repair Qualification Field Product Cost Component
Technology Stack • Big Data • Cloudera Hadoop • Hive / Impala • Traditional database • MSSQL • Spotfire Analytics • R Statistical Programming (TERR)
Use big data and analytics to: • Detect technology & quality trends • Consistently apply strategies to products in the NPI Phase • Apply statistical models at scale
Detect Technology & Quality Trends Drove a major shift in test strategy Multi-year view of a design / component margin Trend for 1 electrical test parameter (65 products, 6 years, 100M measurements)
Consistently apply test strategies to a new product Drives the most cost effective test solution up front in the NPI cycle Launch Lean vs. launch and optimize Test strategy dashboard that facilitates choosing the best test optimization strategy for a new product
Apply statistical models / algorithms at scale Determine component variability vs. design margin with higher confidence Reduce non-value-add tests Cpk analysis to determine critical measurement parameters
Use big data and analytics to: • Leverage unstructured / semi-structured data • Perform predictive modeling
Leverage Unstructured, Semi-Structured Data Enhance ICT test log
Predictive Modeling Mock up of linear regression attempting to correlate component types to overall product failure rates