1 / 59

Executing Robust Design

Executing Robust Design. Definition of Robust Design. Robustness is defined as a condition in which the product or process will be minimally affected by sources of variation. A product can be robust: Against variation in raw materials Against variation in manufacturing conditions

berke
Download Presentation

Executing Robust Design

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Executing Robust Design

  2. Definition of Robust Design Robustness is defined as a condition in which the product or process will be minimally affected by sources of variation. A product can be robust: Against variation in raw materials Against variation in manufacturing conditions Against variation in manufacturing personnel Against variation in the end use environment ` Against variation in end-users Against wear-out or deterioration

  3. LSL Nom USL Low Variation;Minimum Cost Cost LSL USL Nom High Variation;High Cost Cost Why We Need toReduce Variation

  4. Purpose of this Module • To introduce a variation improvement investigation strategy • Can noise factors be manipulated? • To provide the MINITAB steps to design, execute, and analyze a variability response experiment • To provide the MINITAB steps to optimize a design for both mean and variation effects

  5. Objectives of this Module At the end of this module, participants will be able to : • Identify possible variation effects from residual plots • Create a variability response from replicates • Identify possible mean and variance adjustment factors from noise-factor interaction plots • Use the MINITAB Response Optimizer to achieve a process on target with minimum variation

  6. Strategies to Detect Variation Effects • Passive Approach • Noise factors are NOT included, manipulated or controlled in the experimental design • Possible variation effects are identified through analysis of the variability of replicates from an experimental design • Active Approach • Noise factors ARE included in the experimental design in order to force variability to occur • Analysis is similar to the passive approach

  7. The Passive Approach • A factorial experiment is performed using Control factors. Noise factors are not explicitly manipulated nor is an attempt made to control them during the course of the experiment. • Pros • Simple extension of standard experimental techniques • Does not require explicit identification of noise factors • Cons • Requires larger number of replicates than would typically be required to determine mean effects • Requires “true” randomization and replication • Requires that noise factors be “noisy” during the execution of the experiment

  8. How to ensure that noise is noisy? • Let excluded factors vary • Compare noise factor variations prior to and within DOE • Monitor noise factor levels during normal process conditions • Monitor noise factor variation during course of experiment • Compare before/during levels • Run DOE over a longer period of time with : • More replicates • Full randomization

  9. A B A Passive Example • A and B are control factors. Within each treatment combination, noise factors are allowed to naturally fluctuate. Within treatment variation is largely driven by this background noise.

  10. The graphs at right illustrate the type of output which might be obtained from a Robust Parameter Design Experiment. Both are Main Effects plots with the top row showing the main effects of factors A and B on the mean and the bottom row showing the main effects of factors A and B on the variation. Note that in this example the mean and variation can be adjusted independently of each other! Mean Y Variation Y Example output from a Passive Design

  11. The Models • Our objective in performing a designed experiment is to develop a transfer function between the factors (X’s) and the Y. Thus far, we have only addressed the mean of Y. • Now we must also consider the variability of Y • If our experiments are successful at identifying a variation effect, we now have an opportunity to simultaneously optimize both equations!

  12. Example: A Passive Noise Experiment • A design engineer has evaluated the output performance of a circuit design and performed an initial capability analysis of this design to determine if there is a problem with the mean and/or the variability. Stat > Quality Tools > Capability Analysis > Normal Y = Y1Initial; Lower Spec = 58; Upper Spec = 62

  13. Design Capability Analysis • Is there a problem?

  14. 24 Full Factorial Experiment • A 24 full factorial has been designed to determine if four factors have an effect on the mean and/or variability of voltage drop (Y1). There are five replicates for a total of 80 runs, with no center points or blocks. • Resistor R33 (A) • Inductor L3 (B) • Capacitor C23 (E) • Capacitor C29 (F) • Worksheet: “Passive Design”

  15. Passive Analysis Roadmap - Part 1(for Mean Only) • Analyze the response of interest • Factorial Plots (Main Effects, Interaction) • Statistical Results (ANOVA table and p-values) • Residual Plots by factor • Reduce model using statistical results • Use the residuals plot to evaluate potential existence of variation effects • If residuals plot indicates a possible variation effect, go to Passive Analysis Roadmap - Part 2

  16. We sill be using “Student Files Robust Design.mpj” • The following is an outline of Minitab commands and results.

  17. Interaction Plot • Based on the interaction plot, a few of the interactions may be significant. Check the statistical output for verification. Stat > DOE > Factorial > Factorial Plots > Interaction Plot

  18. Main Effects Plot • The main effects plot indicates that factors B and E have the largest effects. Factor A also has a moderate positive effect. Factor F does not seem to be important. Let’s look at the results. Stat > DOE > Factorial > Factorial Plots > Main Effects Plot

  19. Estimated Effects and Coefficients for Y1 (coded units) Term Effect Coef SE Coef T P Constant 55.991 0.2041 274.27 0.000 A 2.363 1.181 0.2041 5.79 0.000 B -3.192 -1.596 0.2041 -7.82 0.000 E 3.312 1.656 0.2041 8.11 0.000 F 0.463 0.231 0.2041 1.13 0.262 A*B 0.178 0.089 0.2041 0.43 0.665 A*E 0.002 0.001 0.2041 0.01 0.995 A*F -0.138 -0.069 0.2041 -0.34 0.737 B*E -0.933 -0.466 0.2041 -2.28 0.026 B*F -0.662 -0.331 0.2041 -1.62 0.110 E*F -0.007 -0.004 0.2041 -0.02 0.985 Factorial Analysis • A preliminary look at the statistical output of the experiment indicates factor F may not be significant. Did we make a mistake by including it in the experimental design? *Note that the 3-way and 4-way interactions are still in the model but not presented in the output above Stat > DOE > Factorial > Analyze Factorial Design

  20. Reduce Model to Significant Terms • Our final model indicates that factors A, B, and E are significant, along with interactions BE, BF, ABF, and BEF, using a p-value cut-off of 0.2 Estimated Effects and Coefficients for Y1 (coded units) Term Effect Coef SE Coef T P Constant 55.991 0.1946 287.74 0.000 A 2.363 1.181 0.1946 6.07 0.000 B -3.192 -1.596 0.1946 -8.20 0.000 E 3.312 1.656 0.1946 8.51 0.000 F 0.463 0.231 0.1946 1.19 0.239 B*E -0.932 -0.466 0.1946 -2.40 0.019 B*F -0.662 -0.331 0.1946 -1.70 0.093 A*B*F -0.513 -0.256 0.1946 -1.32 0.192 B*E*F 0.838 0.419 0.1946 2.15 0.035 S = 1.74046 R-Sq = 73.11% R-Sq(adj) = 70.08% Why do we retain factor F despite a P value greater than 0.2? Stat > DOE > Factorial > Analyze Factorial Design

  21. The Role of Residual Plots in RD • In Robust Parameter Design, the residual plots can show the possibility for a variation effect • Remember from ANOVA and Regression, we stated one of the assumptions on the residuals was constant variance and we checked this via plots Stat > DOE > Factorial > Analyze Factorial Design Choose Graphs > Residuals vs Variables > A B E F

  22. What Next? • After reducing the model, the “Residuals versus Factor F” plot still indicates that F contributes to a variation effect. This finding should encourage us to move further in the analysis of this data to create a variability response and analyze the data. Thus we move on to Part 2 of the roadmap. Stat > DOE > Factorial > Analyze Factorial Design Choose Graphs > Residuals vs Variables > F

  23. Passive Analysis Roadmap - Part 2(if Variation effect present) • Create a Variability Response • Analyze Variability • Factorial Plots (Main Effects, Interaction) • Statistical Results (ANOVA table and p-values) • Reduce model using statistical results • Compare main effects plots for mean and variability to determine which are Mean Adjustment Factors and which are Variance Adjustment Factors (or both) • Use the Multiple Response Optimizer to find optimal settings of the factors • Mean on target • Minimum variability • Perform a capability study / analysis on the resulting factor settings

  24. Create a Variability Response • We are now going to use the replications to make a new response in order to model the variability. Once we have modeled the variability, we can use the MINITAB Response Optimizer to find the settings of the control factors that will put Y on target with minimum variation. • MINITAB makes this easy with a pre-processing of the responses in preparation for a variability analysis • You will see that MINITAB will use the standard deviation as the measure of variability, rather than the variance • the results are equivalent

  25. Raw St Dev Ln (St Dev) Uses Natural Log (Standard Dev of Y) • All of the statistical techniques that we are using to analyze this DOE assume that the data is symmetric (because we are testing for mean differences) • Unfortunately, when we use a calculated standard deviation as a response, we do not meet this assumption because the sampling distribution of variances is expected to be skewed, hence the distribution of standard deviations would also be skewed

  26. Create a Variability Response Stat > DOE > Factorial > Pre-Process Responses for Analyze Variability

  27. Worksheet should now contain the following new columns Create a Variability Response

  28. Analyze the Variability • Analysis of the variability will be essentially identical to the analysis for the mean • Will select the “Terms” to estimate in the model • Will use the Pareto of Effects “Graph” in order to facilitate the first model reduction Stat > DOE > Factorial > Analyze Variability

  29. TERMS Analyze the Variability GRAPHS

  30. Pareto Chart of the Effects • Because we don’t have any degrees of freedom for error, we must look at the Pareto of effects to decide which term to drop into the error and begin to reduce the model Drop ABD interaction first

  31. Regression Estimated Effects and Coefficients for Natural Log of StDevY1 (coded units) Ratio Term Effect Effect Coef SE Coef T P Constant 0.0747 0.01013 7.38 0.002 A 0.5139 1.6718 0.2569 0.01013 25.37 0.000 B -0.2953 0.7443 -0.1477 0.01013 -14.58 0.000 E -0.1521 0.8589 -0.0760 0.01013 -7.51 0.002 F -1.3384 0.2623 -0.6692 0.01013 -66.08 0.000 A*B 0.0371 1.0378 0.0185 0.01013 1.83 0.141 A*E 0.4451 1.5606 0.2225 0.01013 21.98 0.000 A*F -0.2573 0.7731 -0.1287 0.01013 -12.71 0.000 B*F -0.0781 0.9249 -0.0390 0.01013 -3.86 0.018 A*B*E 0.1323 1.1414 0.0661 0.01013 6.53 0.003 B*E*F 0.0850 1.0887 0.0425 0.01013 4.20 0.014 A*B*E*F 0.0390 1.0398 0.0195 0.01013 1.93 0.126 R-Sq = 99.93% R-Sq(adj) = 99.75% Final Model for ln StDevY1 • Once the insignificant terms have been eliminated using a p-value cut-off of 0.2, the reduced model is shown below

  32. Final Model for ln StDevY1

  33. Interaction Plot for StDevY1 • The interaction plot indicates a moderately strong interaction between factors A & E and A & F Where should factors A, B, E and F be set in order to minimize the variability in voltage drop, Y1? Stat > DOE > Factorial > Factorial Plots > Interaction Plot

  34. Main Effects Plot for StDevY1 • Factor F has the largest effect on the variability. Increasing F should reduce variability. But what did the interaction plot show? • Factor A is the next strongest. Set A = 10. What did the interaction plot show? • Factors B and E are weak but what did the interaction plot show? Stat > DOE > Factorial > Factorial Plots > Main Effects Plot

  35. Affects Mean Affects Mean Affects Variation Affects Both Determine Mean & Variation Effects • The graphs at right allow us to directly compare each factor’s singular effect on both the mean and variation • Based on these graphs, • Factors B and E are Mean Adjustment Factors since they affect the mean with little or no effect on the variability • Factor F is a Variance Adjustment Factor since it affects the variability with little or no effect on the mean • Factor A appears to affect both mean and variability

  36. Quality Check: Status of Your Models • Use the “Show Design” icon to check on the status of the analysis. You should make sure that the correct model has been fit for each response that you intend to specify in the response optimizer. • As shown in this window, models have been fit for both the Y1 and StDevY1 responses

  37. Multiple Response Optimizer • Set the Weight for Y1 to 10 to ensure hitting 60, tight lower & upper range • Read “first-guess” target & upper values for StDevY1 from interaction plots • Note that StDevY1 is in regular units here, NOT logged units! • For StDevY1, set weight low to protect against a bad first guess Stat > DOE > Factorial > Response Optimizer

  38. Multiple Response Optimizer • We use the multiple response optimizer to provide a stacked main effects plot. This plot allows us to interactively manipulate the values of each factor in the model and see the effect on both the mean and the variation. • You can use the red sliders to tune each of the factors

  39. Use the Equations to Confirm Y1 • Let’s use the model coefficients to predict and see that it matches (make sure to use un-coded)! • From the optimized solution, A = 13.4878, B = 1, E = 13.5, F = 69 Y1 = -22.0994 + 0.214670*A + 45.2619*B + 4.71125*E + 0.242708*F - 3.26279*B*E - 0.607676*B*F + 0.000108988*A*B*F + 0.0423718*B*E*F Y1 = -22.0994 + 0.214670*13.4878 + 45.2619*1 + 4.71125*13.5 + 0.242708*69 - 3.26279*1*13.5 -0.607676*1*69 + 0.000108988*13.4878*1*69 + 0.0423718*1*13.5*69 Y1 =60.0001, as seen in the optimizer window

  40. Use the Equations to Confirm StDevY1 • Again, make sure to use the un-coded coefficients! • Again, A = 13.4878, B = 1, E = 13.5, F = 69 lnStDevY1 = 15.4015 - 0.001778*A + 0.727714*B - 0.927015*E - 0.0566905*F - 0.152626*A*B + 0.0533652*A*E - 0.00978998*A*F + 0.0242198*B*F + 0.00983241*A*B*E - 0.00282966*B*E*F + 0.0000317*A*B*E*F lnStDevY1 = 15.4015 - 0.001778*13.4878 + 0.727714*1 - 0.927015*13.5 - 0.0566905*69 - 0.152626*13.4878*1 + 0.0533652*13.4878*13.5 - 0.00978998*13.4878*69 + 0.0242198*1*69 + 0.00983241*13.4878*1*13.5 - 0.00282966*1*13.5*69 + 0.0000317*13.4878*1*13.5*69 lnStDevY1 = -0.5577 StDevY1 = e-0.5577 = 0.5725, as seen in the optimizer

  41. Final Design Capability Analysis • Did we achieve our objectives? worksheet “passive capability” Stat > Quality Tools > Capability Analysis > Normal Y = Y1Final; Lower Spec = 58; Upper Spec = 62

  42. Remember the Two Strategies? • We just reviewed the Passive Approach • Noise factors are NOT included, manipulated or controlled in the experimental design • We analyzed the variability of replicates from an experimental design • Now we will look at the Active Approach • Noise factors ARE included in the experimental design in order to force variability to occur • We will see that the analysis is similar to the passive approach

  43. The Active Approach • A factorial experiment is performed using Control AND Noise factors in the same experiment. Analysis can be performed by characterizing Control*Noise interactions only or by moving forward to analyze the variability by dropping the noise factors into the error term. • Pros • Simple extension of standard experimental techniques • Guarantees noise in the Noise factors • Provides for flexibility in analysis methods • Can allow for reduced replication • Cons • Requires ability to manipulate and control Noise factors • Optimal designs for minimization of unneeded effects (noise by noise interactions) can be difficult to create

  44. Example: An Active Noise Experiment • 3 control factors • 1 noise factor • 24 full factorial design • Two Approaches to Analysis • Use only interpretation of interaction plots to choose settings of the control factors to minimize effect of noise • Model the variability by dropping the noise factors into the error and analyze like the passive approach

  45. Active Analysis Roadmap – Plots Only • Create and execute with noise included as a factor • Analyze the response of interest • Factorial Plots (Main Effects, Interaction) • Statistical Results (ANOVA table and p-values) • Reduce model using statistical results • Review Interactions Plot • Interpret the interaction plots to look for evidence of variation effects • Review Main Effects Plot (if applicable) • Use the Multiple Response Optimizer to find the optimal settings of the factors such that the mean is on target • Will force in settings obtained from the interaction plots • Perform a capability study / analysis on the resulting factor settings

  46. An engineer is interested in improving the stability and robustness of a filtration product Review the capability of the current performance to determine the opportunity to apply robust design techniques Example: An Active Noise Experiment Stat > Quality Tools > Capability Analysis > Normal Y = Y4Initial; Lower Spec = 60; Upper Spec = 80

  47. Design Capability Analysis • What conclusions can you draw from this graph?

  48. Example: An Active Noise Experiment • The device contains several control factors from which three were identified as DOE candidates • Pressure (A) • Concentration (B) • Stir Rate (C) • Ambient Temperature was identified as being significant, but not economically controllable • Temperature would not change appreciably during the time in which it would take to execute a three factor experiment • Decided to include it as a factor in the design to force it to change • Call this Factor G

  49. The Experimental Design • A 24-1 fractional design (Res IV) was rejected because the 2-way interactions are of great interest in this experiment • A 24 full factorial design was used • Because of time constraints, only 1 replicate was performed • The variables are listed below: • A = Pressure • B = Concentration • C = Stir Rate • G = Temperature • The data is in worksheet “Active Design” • Open worksheet “Active Design” within “Robust Design.mpj”

  50. Factorial Analysis • This DOE is an unreplicated, 4-factor full factorial • We need to create the “Pareto of Effects” chart Stat > DOE > Factorial > Analyze Factorial Design

More Related