The Lady Tasting Tea

1. The Lady Tasting Tea

2. Fisher’s Exact Test • Time: 1920s • Place Cambridge, England • Setting: An afternoon tea party at the University • Claim: “I can tell whether the milk is poured first and the tea is added next, or whether the tea is poured first and the milk is added to the tea.”

3. Fisher was at the party! Sir Ronald Aylmer Fisher was a British statistician • The most influential statistician so far “Randomization, variance, the null hypothesis, maximum likelihoods – all these are tools used by every scientists today; we owe them all to Fisher. He almost single-handedly created the foundations of modern statistics.” Significance, 2013 Be careful what you claim if you are at a party with Dr. Fisher!

4. Brief digression:Was there really a lady tasting tea? • When I first heard this story, I thought it was apocryphal (made up). I thought Fisher was just using it as an example. • But I have come across some accounts that claim the story is real, although the accounts do not always agree on all the details. • In David Salsburg’s book: “The Lady Tasting Tea” • The tea party took place in Cambridge, England. • Late 1920s • “A group of university dons, their wives, and some guests were sitting around an outdoor table for afternoon tea.” • “Fisher does not describe the outcome of the experiment that sunny afternoon in Cambridge, but Professor Smith told me that the lady identified every single one of the cups correctly.” • In a recent article by Stephen Senn in “Significance” • The tea party took place in Rothamsted research station, just north of London, England. • “Three scientists were taking tea in the common room at an agricultural research station one afternoon in the early 1920s.” • Fisher was there. Dr. Muriel Bristol, a researcher who studied algae, was “the lady.” William Roach, a biochemist, and the fiancé of Ms Bristol. • “Our experiment consists in mixing eight cups of tea . . .”

5. Fisher considers how to test the claim • Try one cup? But 50% chance of guessing correctly • Try two cups? But then . . . Zero 25% One 50% Two 25%

6. Plan a number of trials • Arrange a number of cups • Fisher proposed 8 cups • Half with tea first • Half with milk first • Present them in random order • Then have the lady taste them and make her decisions

7. Taste the tea and make a decision Tea first (Put four cups here) Milk first (Put four cups here)

8. Taste the tea and make a decision Tea first (Put four cups here) Milk first (Put four cups here)

9. Now tally the resultsHow many did she identify correctly? What really happened first Here is one possibility Milk Tea “Milk” The lady’s guess “Tea” So she was mostly correct!

10. 1 3 0 4 1 3 4 0 4 3 1 3 1 0 0 4 What are all the possibilities? All incorrect Evenly? Success! Fisher used the hypergeometric distribution to figure out the probabilities (a+b)! (c+d)! (a+c)! (b+d)!P (of an arrangement) = --------------------------------- N! a! b! c! d!

11. 3 a 1 b c 1 3 d Let’s try this for one possible outcome: What is the probability of getting six out of eight correct? (Just by chance) Here the results show a total of six correct Notation for the cells ! = factorial notation (a+b)! (c+d)! (a+c)! (b+d)!P (of an arrangement) = --------------------------------- N! a! b! c! d! (4)! (4)! (4)! (4)!P (of an arrangement) = ------------------------8! 3! 1! 1! 3! (4x3x2x1) (4x3x2x1) (4x3x2x1) (4x3x2x1)P = ---------------------------------------------------(8x7x6x5x4x3x2x1) (3x2x1) (1) (1) (3x2x1) P = 0.229 The probability of getting this set of results just by chance.

12. 0 4 2 1 3 3 0 2 4 1 0 2 4 3 1 4 1 3 2 0 p=.014 p=.229 p=.514 p=.229 p=.014

13. And now . . . We use Fisher’s Exact test in many situations beyond tea tasting!