https://en.wikipedia.org/wiki/Lady_tasting_tea Jump to content [ ] Main menu Main menu move to sidebar hide Navigation * Main page * Contents * Current events * Random article * About Wikipedia * Contact us * Donate Contribute * Help * Learn to edit * Community portal * Recent changes * Upload file [wikipe] Wikipedia The Free Encyclopedia Search [ ] Search [ ] Appearance * Create account * Log in [ ] Personal tools * Create account * Log in Pages for logged out editors learn more * Contributions * Talk Contents move to sidebar hide * (Top) * 1 The experiment * 2 The Lady Tasting Tea book * 3 See also * 4 References [ ] Toggle the table of contents Lady tasting tea [ ] 12 languages * l`rby@ * Espanol * Euskara * Francais * Hayeren * `bryt * Ri Ben Yu * Portugues * Russkii * Simple English * Ukrayins'ka * Zhong Wen Edit links * Article * Talk [ ] English * Read * Edit * View history [ ] Tools Tools move to sidebar hide Actions * Read * Edit * View history General * What links here * Related changes * Upload file * Special pages * Permanent link * Page information * Cite this page * Get shortened URL * Download QR code * Wikidata item Print/export * Download as PDF * Printable version In other projects Appearance move to sidebar hide From Wikipedia, the free encyclopedia Famous randomized experiment [220px-Nice_Cup_of_Tea]The experiment asked whether a taster could tell if the milk was added before the brewed tea, when preparing a cup of tea. [220px-Youngronaldfisher2]Ronald Fisher in 1913 In the design of experiments in statistics, the lady tasting tea is a randomized experiment devised by Ronald Fisher and reported in his book The Design of Experiments (1935).^[1] The experiment is the original exposition of Fisher's notion of a null hypothesis, which is "never proved or established, but is possibly disproved, in the course of experimentation".^[2]^[3] The example is loosely based on an event in Fisher's life. The woman in question, phycologist Muriel Bristol, claimed to be able to tell whether the tea or the milk was added first to a cup. Her future husband, William Roach, suggested that Fisher give her eight cups, four of each variety, in random order.^[4] One could then ask what the probability was for her getting the specific number of cups she identified correct (in fact all eight), but just by chance. Fisher's description is less than 10 pages in length and is notable for its simplicity and completeness regarding terminology, calculations and design of the experiment.^[5] The test used was Fisher's exact test. The experiment [edit] The experiment provides a subject with eight randomly ordered cups of tea - four prepared by pouring milk and then tea, four by pouring tea and then milk. The subject attempts to select the four cups prepared by one method or the other, and may compare cups directly against each other as desired. The method employed in the experiment is fully disclosed to the subject. The null hypothesis is that the subject has no ability to distinguish the teas. In Fisher's approach, there was no alternative hypothesis,^ [2] unlike in the Neyman-Pearson approach. The test statistic is a simple count of the number of successful attempts to select the four cups prepared by a given method. The distribution of possible numbers of successes, assuming the null hypothesis is true, can be computed using the number of combinations. Using the combination formula, with n = 8 {\displaystyle n=8} {\ displaystyle n=8} total cups and k = 4 {\displaystyle k=4} {\ displaystyle k=4} cups chosen, there are ( 8 4 ) = 8 ! 4 ! ( 8 - 4 ) ! = 70 {\displaystyle {\binom {8}{4}} ={\frac {8!}{4!(8-4)!}}=70} {\displaystyle {\binom {8}{4}}={\frac {8!}{4!(8-4)!}}=70} possible combinations. Tea-Tasting Distribution Assuming the Null Hypothesis Success count Combinations of selection Number of Combinations 0 oooo 1 x 1 = 1 1 ooox, ooxo, oxoo, xooo 4 x 4 = 16 2 ooxx, oxox, oxxo, xoxo, xxoo, 6 x 6 = 36 xoox 3 oxxx, xoxx, xxox, xxxo 4 x 4 = 16 4 xxxx 1 x 1 = 1 Total 70 The frequencies of the possible numbers of successes, given in the final column of this table, are derived as follows. For 0 successes, there is clearly only one set of four choices (namely, choosing all four incorrect cups) giving this result. For one success and three failures, there are four correct cups of which one is selected, which by the combination formula can occur in ( 4 1 ) = 4 {\displaystyle {\ binom {4}{1}}=4} {\displaystyle {\binom {4}{1}}=4} different ways (as shown in column 2, with x denoting a correct cup that is chosen and o denoting a correct cup that is not chosen); and independently of that, there are four incorrect cups of which three are selected, which can occur in ( 4 3 ) = 4 {\displaystyle {\binom {4}{3}}=4} {\ displaystyle {\binom {4}{3}}=4} ways (as shown in the second column, this time with x interpreted as an incorrect cup which is not chosen, and o indicating an incorrect cup which is chosen). Thus a selection of any one correct cup and any three incorrect cups can occur in any of 4x4 = 16 ways. The frequencies of the other possible numbers of successes are calculated correspondingly. Thus the number of successes is distributed according to the hypergeometric distribution . Specifically, for a random variable X {\displaystyle X} {\ displaystyle X} equal to the number of successes, we may write X ~ Hypergeometric [?] ( N = 8 , K = 4 , n = 4 ) {\displaystyle X\sim \ operatorname {Hypergeometric} (N=8,K=4,n=4)} {\displaystyle X\sim \ operatorname {Hypergeometric} (N=8,K=4,n=4)}, where N {\displaystyle N} {\displaystyle N} is the population size or total number of cups of tea, K {\displaystyle K} {\displaystyle K} is the number of success states in the population or four cups of either type, and n {\displaystyle n} {\displaystyle n} is the number of draws, or four cups. The distribution of combinations for making k selections out of the 2k available selections corresponds to the kth row of Pascal's triangle, such that each integer in the row is squared. In this case, k = 4 {\displaystyle k=4} {\displaystyle k=4} because 4 teacups are selected from the 8 available teacups. The critical region for rejection of the null of no ability to distinguish was the single case of 4 successes of 4 possible, based on the conventional probability criterion < 5%. This is the critical region because under the null of no ability to distinguish, 4 successes has 1 chance out of 70 ([?] 1.4% < 5%) of occurring, whereas at least 3 of 4 successes has a probability of (16+1)/70 ([?] 24.3% > 5%). Thus, if and only if the lady properly categorized all 8 cups was Fisher willing to reject the null hypothesis - effectively acknowledging the lady's ability at a 1.4% significance level (but without quantifying her ability). Fisher later discussed the benefits of more trials and repeated tests. David Salsburg reports that a colleague of Fisher, H. Fairfield Smith , revealed that in the actual experiment the lady succeeded in identifying all eight cups correctly.^[6]^[7] The chance of someone who just guesses of getting all correct, assuming she guesses that any four had the tea put in first and the other four the milk, would be only 1 in 70 (the combinations of 8 taken 4 at a time). The Lady Tasting Tea book [edit] David Salsburg published a popular science book entitled The Lady Tasting Tea,^[6] which describes Fisher's experiment and ideas on randomization. Deb Basu wrote that "the famous case of the 'lady tasting tea'" was "one of the two supporting pillars ... of the randomization analysis of experimental data."^[8] Back then, the upper classes pour first the tea, while the lower classes poured the milk first. In the 1950s, when U and non-U English was proposed, the term miffy came to mean those who pour milk first.^ [9] See also [edit] * Hypergeometric distribution * Permutation test * Random assignment * Randomization test * Binomial Distribution References [edit] 1. ^ Fisher 1971, II. The Principles of Experimentation, Illustrated by a Psycho-physical Experiment. 2. ^ ^a ^b Fisher 1971, Chapter II. The Principles of Experimentation, Illustrated by a Psycho-physical Experiment, Section 8. The Null Hypothesis. 3. ^ OED quote: 1935 R. A. Fisher, The Design of Experiments ii. 19, "We may speak of this hypothesis as the 'null hypothesis' [...] the null hypothesis is never proved or established, but is possibly disproved, in the course of experimentation." 4. ^ Sturdivant, Rod. "Lady Tasting Tea" (PDF). Archived from the original (PDF) on 10 July 2004. Retrieved 2 September 2018. 5. ^ Fisher, Sir Ronald A. (1956) [The Design of Experiments (1935)]. "Mathematics of a Lady Tasting Tea". In James Roy Newman (ed.). The World of Mathematics, volume 3. Courier Dover Publications. ISBN 978-0-486-41151-4. 6. ^ ^a ^b Salsburg (2002) 7. ^ Box, Joan Fisher (1978). R.A. Fisher, The Life of a Scientist. New York: Wiley. p. 134. ISBN 0-471-09300-9. 8. ^ Basu (1980a, p. 575; 1980b) 9. ^ Hacking, Ian (1988). "Telepathy: Origins of Randomization in Experimental Design". Isis. 79 (3): 427-451. ISSN 0021-1753. * Fisher, Ronald A. (1971) [1935]. The Design of Experiments (9th ed.). Macmillan. ISBN 0-02-844690-9. * Basu, D. (1980a). "Randomization Analysis of Experimental Data: The Fisher Randomization Test". Journal of the American Statistical Association. 75 (371): 575-582. doi:10.2307/2287648. JSTOR 2287648. * Basu, D. (1980b). "The Fisher Randomization Test", reprinted with a new preface in Statistical Information and Likelihood : A Collection of Critical Essays by Dr. D. Basu; J. K. Ghosh, editor. Springer 1988. * Kempthorne, Oscar (1992). "Intervention experiments, randomization and inference". In Malay Ghosh and Pramod K. Pathak (ed.). Current Issues in Statistical Inference - Essays in Honor of D. Basu. Institute of Mathematical Statistics Lecture Notes - Monograph Series. Hayward, CA.: IMS. pp. 13-31. doi:10.1214/lnms/ 1215458836. ISBN 0-940600-24-2. * Salsburg, D. (2002) The Lady Tasting Tea: How Statistics Revolutionized Science in the Twentieth Century, W.H. Freeman / Owl Book. ISBN 0-8050-7134-2 * Retrieved from "https://en.wikipedia.org/w/index.php?title= Lady_tasting_tea&oldid=1238130580" Categories: * Design of experiments * Statistical hypothesis testing * Science experiments * Ronald Fisher Hidden categories: * Articles with short description * Short description matches Wikidata * This page was last edited on 2 August 2024, at 08:10 (UTC). * Text is available under the Creative Commons Attribution-ShareAlike License 4.0 ; additional terms may apply. By using this site, you agree to the Terms of Use and Privacy Policy. Wikipedia(r) is a registered trademark of the Wikimedia Foundation, Inc., a non-profit organization. * Privacy policy * About Wikipedia * Disclaimers * Contact Wikipedia * Code of Conduct * Developers * Statistics * Cookie statement * Mobile view * Wikimedia Foundation * Powered by MediaWiki *