https://statmodeling.stat.columbia.edu/2022/12/02/not-frequentist-enough-2/ Skip to primary content Statistical Modeling, Causal Inference, and Social Science Search [ ] [Search] Main menu * Home * Authors * Blogs We Read * Sponsors Post navigation "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshell Alison Bechdel (4) vs. Willie Nelson; Hammurabi advances Not frequentist enough. Posted on December 2, 2022 9:52 AM by Andrew I think that many mistakes in applied statistics could be avoided if people were to think in a more frequentist way. Look at it this way: In the usual way of thinking, you apply a statistical procedure to the data, and if the result reaches some statistical-significance threshold, and you get similar results from a robustness study, changing some things around, then you've made a discovery. In the frequentist way of thinking, you consider your entire procedure (all the steps above) as a single unit, and you consider what would happen if you apply this procedure to a long series of similar problems. The first thing to recognize is that the frequentist way of thinking requires extra effort: you need to define this potential series of similar problems and then either do some mathematical analysis or, more likely, set up a simulation on the computer. In the usual way of teaching statistics, the extra effort required by the frequentist approach is not clear, for two reasons. First, textbooks present the general theory in the context of very simple examples such as linear models with no selection, where there are simple analytic solutions. Second, textbook examples of statistical theory typically start with an assumed probability model for the data, in which case most of the hard work has already been done. The model is just there, postulated; it doesn't look like a set of "assumptions" at all. It's the camel that is the likelihood (although, strictly speaking, the likelihood is not the data model; additional assumptions are required to go from an (unnormalized) likelihood function to get a generative model for the data). An example To demonstrate this point, I'll use an example from a recent article, Criticism as asynchronous collaboration: An example from social science research, where I discussed a published data analysis that claimed to show that "politicians winning a close election live 5-10 years longer than candidates who lose," with this claim being based on a point estimate from a few hundred elections: the estimate was statistically significantly different from zero and similar estimates were produced in a robustness study in which various aspects of the model were tweaked. The published analysis was done using what I describe above as "the usual way of thinking." Now let's consider the frequentist approach. We have to make some assumptions. Suppose to start with that losing an election has the effect of increasing your lifespan by X years, where X has some value between -1 and 1. (From an epidemiological point of view, an effect of 1 year is large, really on the high end of what could be expected from something as indirect as winning or losing an election.) From there you can work out what might happen from a few hundred elections, and you'll see that any estimate will be super noisy, to the extent that if you fit a model and select on statistical significance, you'll get an estimated effect that's much higher than the real effect (a large type M error, as we say). You'll also see that, if you want to get a large effect (large effects are exciting, right!) then you'll want the standard error of your estimate to be larger, and you can get this by the simple expedient of predicting future length of life without including current age as a predictor. For more discussion of all these issues, see section 4 of the linked article. My point here is that whatever analysis we do, there is a benefit to thinking about it from a frequentist perspective--what would things look like if the procedure were replied repeatedly to many datasets?--rather than to fixate on the results of the analysis as applied to the data at hand. This entry was posted in Bayesian Statistics, Decision Theory, Miscellaneous Statistics, Political Science, Zombies by Andrew. Bookmark the permalink. 22 thoughts on "Not frequentist enough." 1. [48458385]Frank Harrell on December 2, 2022 10:15 AM at 10:15 am said: It is still important to ask: (1) What is the quantified evidence from the first analysis? and (2) Is the first analysis worth attempting to be replicated? These are not frequentist questions in spirit. The point about analyses using an assumed probability model is especially clear and harks to the inclusion of more parameters in a (primarily Bayesian) analysis to recognize what we don't know (e.g., degree of non-normality, degree of unequal variances, etc.). Starting the process with an assumption-laden model (whether frequentist or Bayesian methods are being used) leads to false downstream confidence. Reply | + []jd on December 2, 2022 10:36 AM at 10:36 am said: >Starting the process with an assumption-laden model (whether frequentist or Bayesian methods are being used) leads to false downstream confidence. Aren't all models rather assumption-laden? Are you referring to particular kinds of assumptions? Reply | o [1e06]Anoneuoid on December 2, 2022 12:03 PM at 12:03 pm said: Starting the process with an assumption-laden model And Andrew wrote: additional assumptions are required to go from an (unnormalized) likelihood function to get a generative model for the data). Both of these descriptions are a bit misleading. The process always starts with some assumptions, which are collectively called the model. From those assumptions we then derive the likelihood. If the likelihood is later shown to be inconsistent with the data, you can only conclude at least one of those assumptions were incorrect (duhem-quine thesis). Meanwhile, when it is consistent, you still cannot rule out that another set of assumptions could lead to an even better fit (affirming the consequent). Reply | # [d582]Andrew on December 2, 2022 12:12 PM at 12:12 pm said: Anon: Just for example, you can write a likelihood for a regression model without a generative model for the predictors. But to simulate replicated data you do need that generative model. So it's more assumptions. I agree with you that assumptions are always needed: see "Guarantee" is another word for "assumption" and All the Assumptions That Are My Life. # [1e06]Anoneuoid on December 2, 2022 2:58 PM at 2:58 pm said: Theres gotta be some assumptions made about how the predictors were generated. Maybe they aren't explicitly stated, but if you derive the likelihood from scratch they've got to be there. No? 2. [71d3fdf5]David Marcus on December 2, 2022 10:23 AM at 10:23 am said: > In the usual way of thinking, you apply a statistical procedure to the > data, ... That may be "usual", but it would be better to come up with a model (and prior) that you believe, then use them to analyze your data. Reply | 3. [af01e1dc]Michael Schwartz on December 2, 2022 10:41 AM at 10:41 am said: "From there you can work out what might happen from a few hundred elections, and you'll see that any estimate will be super noisy" This seems drawing the Owl. You know, step 1 draw two ovals, step 2 draw beautiful, photorealistic owl. It's not entirely clear to me how you can work this out. I think this is where many (me included) stumble - these things are not so obvious to hoi polloi. I believe what you say is true (deference to authority), but I would be hard-pressed to write down the details and defend them. Reply | + [d582]Andrew on December 2, 2022 11:33 AM at 11:33 am said: Michael: OK, I guess I should write more on this. But for now let me keep it simple. Suppose you're a researcher and you have some idea of the model you might want to fit. For example, a discontinuity regression, which can be written as a linear regression with an outcome of interest (in this case, remaining years of life), a running variable (in this case, electoral vote margin), an indicator for if the running variable is greater than zero, and some pre-treatment variables (in this case, candidate age at the time of the election). Then the first step is to turn your fitted model into a generative model. For linear regression, that's easy, it's just y = x*b + error. The next step is to make assumptions about all the parameters in the model: the intercept, the coefficients, and the error term. We can do that! If the outcome is remaining life in years, let's just guess that the average age of candidates for governor is 55 years, and their average remaining years of life is 20. That's perhaps an overestimate given that these people have already reached 55 years, but then again we'll be dealing with old data, and life expectancy didn't use to be so long . . . anyway, the exact number doesn't really matter. So let's put in 20 for the intercept on our regression. Then the coefficient for electoral vote margin: I have no idea on this, so I'll just assume it's 0. Again, this is not so important, as it's just a variable we're adjusting for in our analysis. Next we need the coefficient for the discontinuity. I have no idea on this either, but I'm pretty sure it won't be more than 1, as it takes a hella lot to increase or decrease average life expectancy by a year. Let's try 1 just to see what happens under this assumption that the effect is very large. Then we need the coef for age. Let's assume it's coded as age minus 55 so we don't have to worry about the intercept from earlier. I'll give it a coef of -0.9: the older you are, the less future life expectancy you will have. Or maybe -0.99 would be even better. We could always try it both ways, just to see if it makes a difference. Finally, we need a residual standard error. I'll say 10, i.e. approximately two-thirds of people live to within +/-10 years of their predicted life expectancy. OK, now that we have the model, let's simulate data. Suppose we have 500 elections. The only thing we need now is to simulate the predictors in the model. For simplicity, I'll assume ages of candidates are normally distributed with mean 55 and standard deviation 10 (so that 95% are between the ages of 30 and 75), and I'll assume that we're only considering close elections, so the vote margin is uniformly distributed between +/- 0.1 (that is, the candidate gets between 45% and 55% of the two-party vote) and that it's independent of candidate age. Here goes: library("rstanarm") n <- 500 age <- rnorm(n, 55, 10) margin <- runif(n, -0.1, 0.1) win <- ifelse(margin > 0, 1, 0) y <- 20 + 0*margin + 0*win - 0.9*age + rnorm(n, 0, 10) fake <- data.frame(age, margin, win, y) fit <- stan_glm(y ~ win + margin + age, data=fake, refresh=0, algorithm="optimizing") print(fit) Let's check that it gives reasonable output: stan_glm family: gaussian [identity] formula: y ~ win + margin + age observations: 500 predictors: 4 ------ Median MAD_SD (Intercept) 13.8 2.6 win 1.2 1.8 margin -4.3 15.5 age -0.8 0.0 Auxiliary parameter(s): Median MAD_SD sigma 9.7 0.3 OK, now I'll loop it 100 times: n_loop <- 100 b_hat <- rep(NA, n_loop) b_se <- rep(NA, n_loop) for (loop in 1:n_loop){ n <- 500 age <- rnorm(n, 55, 10) margin <- runif(n, -0.1, 0.1) win <- ifelse(margin > 0, 1, 0) y <- 20 + 0*margin + 1*win - 0.9*age + rnorm(n, 0, 10) fake <- data.frame(age, margin, win, y) fit <- stan_glm(y ~ win + margin + age, data=fake, refresh=0, algorithm="optimizing") b_hat[loop] <- coef(fit)["win"] b_se[loop] <- se(fit)["win"] } print(c(mean(b_hat), sd(b_hat))) print(mean(b_se)) And here's what we get: > print(c(mean(b_hat), sd(b_hat))) [1] 1.11 1.81 > print(mean(b_se)) [1] 1.79 So, under the above assumptions, we will be able to estimate this discontinuity effect to within a standard error of about 1.8. This tells us that the study is too small to reliably estimate an effect of 1 year of age. Does that help? P.S. Yes, the above R code is kinda ugly. It's how I do things so maybe there's a virtue here in that it demonstrates how even someone like me who's a crude coder can still do this sort of simulation. P.P.S. If you show this to the authors of the original study, they might reply that the true effect is actually 5 to 10 years, not just one year, in which case my above analysis is all wrong. My reply is that it's ludicrous to think that losing an election could cost an average of 5 to 10 years of life. Even if every losing candidate immediately took up the pastimes of smoking and sky diving and stuck with it for the rest of their (shortened) lives, and even if every winning candidate gave up cigarettes, alcohol, and steaks (unlikely for a politician, huh?) and performed regular yoga and meditation . . . even with all of that, I wouldn't expect to see such a large average effect as 5 years of life expectancy. Such a claim just contradicts everything else we know about life expectancy (except for other noisy statistical analyses selecting on statistical significance). But, in any case, the P.P.S. here is not really relevant to the main point of this comment, which is that, yes, it should not be difficult to set up this simulation before collecting the data and doing the analysis. Indeed, I think that being able to set up such simulations is an important part of learning applied regression, which is why we have a lot of these in Regression and Other Stories. Maybe not enough, though. Reply | o []jd on December 2, 2022 12:21 PM at 12:21 pm said: I also code like this...so I guess I'm an ugly coder too. The P.P.S. - I understand the main point of the comment was the sim, but as far as evaluation of the study goes, no sim was really needed then (other than to show how a result of 5-10 years is possible from a much smaller true effect), because it appears to all just boil down to the argument that 5-10 years is a ludicrous number. This simply reminds me of the common sense check. I was trying to teach some of the students in our lab some regression modeling this summer. I started by teaching them data simulation of simple scenarios like that in the above code. So instead of showing them first how to run a regression on data, I started off by showing them how to simulate data by coding a generative model. For me, simulation has been extremely helpful in trying to learn how to model data (and thinking about experiments, troubleshooting, etc). I wish I had learned everything in the reverse order that I learned it. Data simulation first, then analysis after. I think it might have been easier to learn modeling if I had first learned how to simulate the data that I was going to model. Reply | # [d582]Andrew on December 2, 2022 12:41 PM at 12:41 pm said: Jd: The point of the simulation is that, even before seeing the data, the researchers could've realized that they did not have enough data to reliably study what they were trying to study. And, yes, 5-10 years is a ludicrous number--but I can only say that because I have some statistical numeracy. The idea of a particular event shortening one person's life expectancy by 5-10 years, that's plausible--just barely plausible, maybe, but plausible. It tips over into ludicrousness when it's supposed to be the average effect in a population, cos then it would require these just-barely-plausible things happening for all or most people. By analogy, the idea of a perpetual motion machine is ludicrous--but only if you know enough physics, or trust enough physicists. If you just reason from intuition, you might say, "Yeah, sure, I could imagine a perpetual motion machine." People could imagine unicorns too, even though they never seem to have actually existed. # []jd on December 2, 2022 1:29 PM at 1:29 pm said: "The point of the simulation is that, even before seeing the data, the researchers could've realized that they did not have enough data to reliably study what they were trying to study." Sure, but isn't that realization possible only by assuming that they know beforehand that 5-10 years is ludicrous? Only then could they have realized this through a simulation as you did. No simulation is going to help if one's assumptions are so wildly off that ludicrous effect sizes are genuinely plausible and thus get programmed into the simulation (as you point out could be their counterargument to your simulation). With wildly large effect sizes, it wouldn't be difficult to fool oneself in a simulation. Some basic knowledge of life expectancy, physics (perpetual motion machines), or equines (unicorns, ?) would seem a prerequisite to embarking upon a study anyway. As far as I can see, the common sense rule still applies and would actually be necessary to perform the simulation that gave the answer that you argue. # [d582]Andrew on December 2, 2022 1:45 PM at 1:45 pm said: Jd: Sure, common sense helps. The point is that to do the simulation you need to put in some assumptions. If, before seeing the data, they wanted to put in the assumption that losing the election would cost on average 5 years of life, then, sure, they could go for it. And then if they were to send that analysis around, maybe someone would've pointed out the problem in that particular assumption. Or not! I'm not saying that doing this sort of simulation will protect from all errors. 4. []jbayes on December 2, 2022 10:50 AM at 10:50 am said: In the frequentist way of thinking, you consider your entire procedure (all the steps above) as a single unit, and you consider what would happen if you apply this procedure to a long series of similar problems. I consider all of Statistics as a single unit and one entire procedure. Reply | + [2685]Jonathan (another one) on December 2, 2022 11:28 AM at 11:28 am said: I consider all of reality a wavefunction with occasional local collapses. Reply | o [4b06]jbayes on December 2, 2022 11:49 AM at 11:49 am said: So all of statistics is really a kind of global Quantum Mechanics problem! I like where you're going with this. Finally the foundations of statistics is making progress. Reply | o [4b06]jbayes on December 2, 2022 1:04 PM at 1:04 pm said: Wait, you wouldn't believe the bonferonni corrections I'm getting with this approach. Everyone needs to use an alpha =10^(-100^1000) Which reminds me: why do we call large numbers "astronomical"? Numbers in astronomy are always something like 10^50. That's large but not incomprehensible. Maybe there should be a more extreme category called "statistical" for truly incomprehensible numbers. Reply | o [4229]Daniel Lakeland on December 2, 2022 2:10 PM at 2:10 pm said: This puts you in good but generally disregarded company, both John Stewart Bell and David Bohm felt that the only meaningful QM description of the world was that it was all one united wave function (and no such thing as collapses) and no separation between "classical" and "QM" phenomenon exists. This has generally been disregarded or even worse JS Bell's work has been interpreted to mean kind of the exact opposite. Reply | # [2685]Jonathan (another one) on December 2, 2022 2:15 PM at 2:15 pm said: In good but generally disregarded company -- the story of my life. # [cbf7]Carlos Ungil on December 2, 2022 4:54 PM at 4:54 pm said: Only a wavefunction and no such thing as collapses? Bell wrote many things - including the following in one if his latest papers ("Are there quantum jumps? "): "Either the wavefunction, as given by the Schrodinger equation, is not everything, or it is not right. "Of these two possibilities, that the wavefunction is not everything, or not right, the first is developed especially in the de Broglie--Bohm 'pilot wave' picture. [...] "If, with Schrodinger, we reject extra variables, then we must allow that his equation is not always right. I do not know that he contemplated this conclusion, but it seems to me inescapable." And he goes on to describe the GRW model of spontaneous collapse which seemed to him "particularly simple and effective" and "a very nice illustration of how quantum mechanics, to become rational, requires only a change which is very small". 5. [1e06a63a]Anoneuoid on December 2, 2022 1:38 PM at 1:38 pm said: I think this paper is fatally flawed anyway: First, healthy politicians might be more likely to win elections, e.g. if voters are more likely to reward attractive politicians [...] We estimate the causal effect of winning the gubernatorial election using a sharp regression discontinuity design based on close elections. In doing this, we compare the longevity of candidates who narrowly win to candidates who narrowly lose the election. The underlying identification assumption is that candidates within this narrow margin are similar across all other characteristics that might affect longevity. Because election outcomes within this narrow bandwidth can be considered essentially random, the setup allows us to use candidates who narrowly lose the election as a counterfactual for the longevity of candidates who narrowly win--had they instead lost the election. It is much more likely that voters pick up on signs of health than that winning an election can increase longevity by 5+ years. To deal with this huge problem, they just assume that isn't the case. What I'd like to know from the data, is the life expectancy curve over time, and how that compares to the general population. Reply | + [d582]Andrew on December 2, 2022 1:51 PM at 1:51 pm said: Anon: I think you're falling into a common trap, which is trying to explain a pattern that can easily be explained by pure noise. Reply | 6. [4d20f5f7]Casey on December 2, 2022 2:58 PM at 2:58 pm said: > In the frequentist way of thinking, you consider your entire procedure (all the steps above) as a single unit. Non-statistician but fan of the blog here. This is how I came to understand (maybe) what a confidence interval is... and why "range of values with 95% probability, the range will contain the true unknown value of the parameter" (to quote a well-known introductory textbook at my desk) is really quite misleading. It's really that the whole unit (sampling -> interval calculation) that will produce intervals that will contain the true parameter x% of the time it's repeated (as opposed saying something about a single interval). It was doing some simulations that helped me finally get this, though, not parsing someone's explanation of this single interval /procedure distinction I tried to describe above. Reply | Leave a Reply Cancel reply Your email address will not be published. Required fields are marked * [ ] [ ] [ ] [ ] [ ] [ ] [ ] Comment * [ ] Name [ ] Email [ ] Website [ ] [Post Comment] [ ] [ ] [ ] [ ] [ ] [ ] [ ] D[ ] * Art * Bayesian Statistics * Causal Inference * Decision Theory * Economics * Jobs * Literature * Miscellaneous Science * Miscellaneous Statistics * Multilevel Modeling * Papers * Political Science * Public Health * Sociology * Sports * Stan * Statistical computing * Statistical graphics * Teaching * Zombies 1. Carlos Ungil on Not frequentist enough.December 2, 2022 4:54 PM Only a wavefunction and no such thing as collapses? Bell wrote many things - including the following in one if... 2. William Hartmann on Alison Bechdel (4) vs. Willie Nelson; Hammurabi advancesDecember 2, 2022 4:20 PM Just because we choose a seminar speaker, it doesn't mean we will be able to get them to come. Famous... 3. Jonathan (another one) on Alison Bechdel (4) vs. Willie Nelson; Hammurabi advancesDecember 2, 2022 3:08 PM Bechdel is already going around the country giving seminars. https://yaledailynews.com/blog/2022/11/29/ graphic-memoirist-alison-bechdel-to-speak-at-yale/ So why do we want warmed-over ambiguous honesty? "Bechdel is... 4. Anoneuoid on Not frequentist enough.December 2, 2022 2:58 PM Theres gotta be some assumptions made about how the predictors were generated. Maybe they aren't explicitly stated, but if you... 5. Casey on Not frequentist enough.December 2, 2022 2:58 PM > In the frequentist way of thinking, you consider your entire procedure (all the steps above) as a single unit.... 6. Jonathan (another one) on Not frequentist enough.December 2, 2022 2:15 PM In good but generally disregarded company -- the story of my life. 7. Daniel Lakeland on Not frequentist enough.December 2, 2022 2:10 PM This puts you in good but generally disregarded company, both John Stewart Bell and David Bohm felt that the only... 8. Andrew on Not frequentist enough.December 2, 2022 1:51 PM Anon: I think you're falling into a common trap, which is trying to explain a pattern that can easily be... 9. Andrew on Not frequentist enough.December 2, 2022 1:45 PM Jd: Sure, common sense helps. The point is that to do the simulation you need to put in some assumptions.... 10. Anoneuoid on Not frequentist enough.December 2, 2022 1:38 PM I think this paper is fatally flawed anyway: First, healthy politicians might be more likely to win elections, e.g. if... 11. jd on Not frequentist enough.December 2, 2022 1:29 PM "The point of the simulation is that, even before seeing the data, the researchers could've realized that they did not... 12. jbayes on Not frequentist enough.December 2, 2022 1:04 PM Wait, you wouldn't believe the bonferonni corrections I'm getting with this approach. Everyone needs to use an alpha =10^(-100^ 1000) Which... 13. Zhou Fang on Alison Bechdel (4) vs. Willie Nelson; Hammurabi advancesDecember 2, 2022 12:49 PM We need Bechdel to have a conversation with another woman about something other than a man. 14. Andrew on Not frequentist enough.December 2, 2022 12:41 PM Jd: The point of the simulation is that, even before seeing the data, the researchers could've realized that they did... 15. somebody on Time Series Forecasting: futile but necessary. An example using electricity prices.December 2, 2022 12:38 PM Sorry, forgot to give my critiques of this For instance, the 'July effect' for this year is drawn from a... 16. jd on Not frequentist enough.December 2, 2022 12:21 PM I also code like this...so I guess I'm an ugly coder too. The P.P.S. - I understand the main point... 17. Andrew on Not frequentist enough.December 2, 2022 12:12 PM Anon: Just for example, you can write a likelihood for a regression model without a generative model for the predictors.... 18. Joshua on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 12:11 PM Andrew - > Do I trust mainstream media? is just not clear. Yah. OK. I totally agree. It's very subjective.... 19. Anoneuoid on Not frequentist enough.December 2, 2022 12:03 PM Starting the process with an assumption-laden model And Andrew wrote: additional assumptions are required to go from an (unnormalized) likelihood... 20. somebody on Time Series Forecasting: futile but necessary. An example using electricity prices.December 2, 2022 11:57 AM And another thing, something that might be relevant to the decision analysis is if the prices are "artificial" in some... 21. somebody on Time Series Forecasting: futile but necessary. An example using electricity prices.December 2, 2022 11:51 AM Some random observations: 1. In the long term, the model behavior should essentially revert to seasonality effects + an overall... 22. jbayes on Not frequentist enough.December 2, 2022 11:49 AM So all of statistics is really a kind of global Quantum Mechanics problem! I like where you're going with this.... 23. Andrew on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 11:48 AM Joshua: I wasn't there, so I have no idea . . . To me, though, the answer to the question,... 24. Andrew on Not frequentist enough.December 2, 2022 11:33 AM Michael: OK, I guess I should write more on this. But for now let me keep it simple. Suppose you're... 25. Joshua on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 11:29 AM Andrew - I don't get the first part of your comment. Agree with the second part. But here's why I... 26. Jonathan (another one) on Not frequentist enough.December 2, 2022 11:28 AM I consider all of reality a wavefunction with occasional local collapses. 27. Jonathan (another one) on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 11:21 AM Taibbi published his initial reaction to the debate on his Substack today. In his opinion, the change in opinion was... 28. JimV on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 11:08 AM Oh. Wow! I see it now, you're right. Thanks. 29. Andrew on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 11:05 AM Joshua: I'm guessing that you'll get a high percentage of people changing their response because of the framing of this... 30. Ben on The more I thought about them, the less they seemed to be negative things, but appeared in the scenes as something completely new and productiveDecember 2, 2022 11:04 AM > For anyone coming from a more classical stats background, it can seem easy to want to dismiss throwing huge... 31. jbayes on Not frequentist enough.December 2, 2022 10:50 AM In the frequentist way of thinking, you consider your entire procedure (all the steps above) as a single unit, and... 32. Jessica Hullman on The more I thought about them, the less they seemed to be negative things, but appeared in the scenes as something completely new and productiveDecember 2, 2022 10:44 AM A couple years because you drive seemed like an overadjustment to me (car accidents kill a lot of people, but... 33. Michael Schwartz on Not frequentist enough.December 2, 2022 10:41 AM "From there you can work out what might happen from a few hundred elections, and you'll see that any estimate... 34. jd on Not frequentist enough.December 2, 2022 10:36 AM >Starting the process with an assumption-laden model (whether frequentist or Bayesian methods are being used) leads to false downstream confidence.... 35. Joshua on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 10:35 AM Still, 19% changing their view strikes me as a really big number. 36. David Marcus on Not frequentist enough.December 2, 2022 10:23 AM > In the usual way of thinking, you apply a statistical procedure to the > data, ... That may be... 37. Frank Harrell on Not frequentist enough.December 2, 2022 10:15 AM It is still important to ask: (1) What is the quantified evidence from the first analysis? and (2) Is the... 38. Martin Edwin Andersen on Cause he thinks he's so-phisticated December 2, 2022 9:59 AM Re: Jane Fonda, Henry Kissinger and a Question of Treason https:/ /www.laprogressive.com/.amp/war-and-peace/ jane-fonda-henry-kissinger 39. Andrew on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 9:26 AM Typo fixed; thanks. 40. Andrew on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 9:25 AM Yeah, everybody wants to be Jared Diamond, that's the problem. 41. Kevin Nelson on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 2, 2022 3:22 AM The "39%" was a change in the margin. It appears that only 19% of the audience actually changed their view. 42. David, who doesn't drive in Tokyo on The more I thought about them, the less they seemed to be negative things, but appeared in the scenes as something completely new and productiveDecember 2, 2022 1:54 AM I don't get why you are reminded: about 1% of people who drive end up dead due to "accidents". If... 43. Wonks Anonymous on Time Series Forecasting: futile but necessary. An example using electricity prices.December 2, 2022 1:48 AM it's more accurate to say that we do expect events that extreme but only very, very rarely. In the parlance... 44. Mark on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 1, 2022 11:20 PM The other books mentioned in the Guardian piece are on brand too, including Guns, Germs and Steel as the "most... 45. Joshua on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 1, 2022 10:59 PM Well, Taibbi is a beast and that's pretty much his schtick and Murray's a take no prisoners guy also, and... 46. Jessica Hullman on The more I thought about them, the less they seemed to be negative things, but appeared in the scenes as something completely new and productiveDecember 1, 2022 10:31 PM Agreed. This kind of work can seem much less novel and less prestigious to researchers but have way more impact.... 47. Jonathan (another one) on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 1, 2022 9:07 PM Argghhh... Canadian. (And I assume somewhat more educated than the poll averages) 48. Jonathan (another one) on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 1, 2022 9:06 PM It was a Candain crowd, so it started at 52-48 in favor of the mainstream. 49. Joshua on "But shouldn't we prefer these outside delusions . . .": Malcolm Gladwell in a nutshellDecember 1, 2022 7:31 PM That's pretty wild. Given that there's not much public trust in the media to begin with, a 39% change would... 50. Josh Rushton on The more I thought about them, the less they seemed to be negative things, but appeared in the scenes as something completely new and productiveDecember 1, 2022 5:41 PM I appreciate this post a lot. It reminds me of a comment Brad Efron (I think) made in a talk... Proudly powered by WordPress