This paper published in JAMA just won't go away, so I thought I'd do a brief thread on why it says virtually nothing about masks for COVID-19 1/nhttps://twitter.com/NathanStall/status/1287832315004170240 …
You can add location information to your Tweets, such as your city or precise location, from the web and via third-party applications. You always have the option to delete your Tweet location history. Learn more
6/n But presumably the number of HCWs who NEVER tested positive ANY day would always increase, unless the number of tests is fixed (which it presumably isn't) This would then mean that, over time, the % positive should decrease naturally
7/n Then, another snag. The authors have drawn some lines on a graph, but not provided any statistical tests to see if these lines mean anything They report USING the R^2 value, but don't actually write it down! Not idealpic.twitter.com/UNjOmPs3Me
8/n This XKCD comic makes this problem clear very elegantlypic.twitter.com/a5NGp47iPB
9/n On top of all this, the authors report that the case number for COVID-19 continued to increase in Massachusetts (where the study was done), but don't discuss the PERCENT POSITIVE which is what this study is looking at
10/n This is an issue, because if the state has similar trends in % positive as the hospital, then it's likely that what's seen in this study is simply reflective of the COVID-19 epidemic more broadly
11/n Here are the % positive graphs side-by-side They look, to me, remarkably similar Maybe it wasn't the masks after all...pic.twitter.com/Rt9BVZL4eW
11/n In addition, there are some other worries with the paper Because it's a research letter, they can't really go into confounding, but they do mention it as an issuepic.twitter.com/PkfzwYQOdE
12/n Problem is, confounding in this study isn't just a small problem - it's an enormous, gaping hole in the reliability of the results
13/n What if people were wearing masks before the study started? What if the population of HCWs changed during the pandemic? What if reporting of tests changed? What if they simply DID MORE TESTS? So many problems, no answers at all
14/n To some extent, it's hard to blame the authors for these issues, but it shows why you probably shouldn't report on research letters - they just don't have enough information to make a balanced judgement
15/n At the absolute minimum for this study, you need an adequate control group to even begin to understand what these results might mean
Without that, about all we can say is that they made a pretty graph with lines on it
Note: all of this is independent of whether you like masks! I'm not saying masks don't work, just that this study says nothing about the question
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.