50 likes | 154 Views
Confirmatory Statistics: Identifying, Framing and Testing Hypotheses. Simon French simon.french@warwick.ac.uk. Cynefin and statistics. Unique events. exploratory analyses. Repeatable events. Events?. Estimation and confirmatory analysis. Value focused thinking.
E N D
Confirmatory Statistics:Identifying, Framing and Testing Hypotheses Simon French simon.french@warwick.ac.uk
Cynefin and statistics Uniqueevents exploratoryanalyses Repeatable events Events? Estimation andconfirmatoryanalysis
Value focused thinking • “Values are what we care about. As such, values should be the driving force for our decision making. They should be the basis for the time and effort we spend thinking about decisions. But this is not the way it is. It is not even close to the way it is.” Keeney (1992) • Define objectives, research questions, hypotheses at outset • (probably modify pragmatically as research progresses!) • More creative in research design • Focuses attention on what matters • Helps identify the ‘right’ research/problem solving methodology Note: whether we talk of objectives, research questions, hypotheses depends on type of research project
Confirmatory Statistics • About checking whether data are compatible with some hypothesis or model • Note: • we can never show a model or hypothesis is ‘true’ • And seldom can we completely falsify it – randomness usually clouds the issue. • The processes are much more about weighing strength of evidence
Hypothesis testing • Note that 5% significance level means that 1 in 20 tests will ‘reject the null hypothesis’ when it is true. • Thus if you perform lots of tests in your research you will necessarily make lots of mistakes!!!!! • There are theories of multiple testing to help avoid misinterpretation in such cases