6/n But presumably the number of HCWs who NEVER tested positive ANY day would always increase, unless the number of tests is fixed (which it presumably isn't) This would then mean that, over time, the % positive should decrease naturally
-
Show this thread
-
7/n Then, another snag. The authors have drawn some lines on a graph, but not provided any statistical tests to see if these lines mean anything They report USING the R^2 value, but don't actually write it down! Not idealpic.twitter.com/UNjOmPs3Me
1 reply 1 retweet 7 likesShow this thread -
8/n This XKCD comic makes this problem clear very elegantlypic.twitter.com/a5NGp47iPB
1 reply 6 retweets 23 likesShow this thread -
9/n On top of all this, the authors report that the case number for COVID-19 continued to increase in Massachusetts (where the study was done), but don't discuss the PERCENT POSITIVE which is what this study is looking at
1 reply 0 retweets 4 likesShow this thread -
10/n This is an issue, because if the state has similar trends in % positive as the hospital, then it's likely that what's seen in this study is simply reflective of the COVID-19 epidemic more broadly
1 reply 0 retweets 3 likesShow this thread -
11/n Here are the % positive graphs side-by-side They look, to me, remarkably similar Maybe it wasn't the masks after all...pic.twitter.com/Rt9BVZL4eW
1 reply 1 retweet 6 likesShow this thread -
11/n In addition, there are some other worries with the paper Because it's a research letter, they can't really go into confounding, but they do mention it as an issuepic.twitter.com/PkfzwYQOdE
1 reply 0 retweets 3 likesShow this thread -
12/n Problem is, confounding in this study isn't just a small problem - it's an enormous, gaping hole in the reliability of the results
1 reply 0 retweets 3 likesShow this thread -
13/n What if people were wearing masks before the study started? What if the population of HCWs changed during the pandemic? What if reporting of tests changed? What if they simply DID MORE TESTS? So many problems, no answers at all
1 reply 0 retweets 2 likesShow this thread -
14/n To some extent, it's hard to blame the authors for these issues, but it shows why you probably shouldn't report on research letters - they just don't have enough information to make a balanced judgement
1 reply 0 retweets 3 likesShow this thread
15/n At the absolute minimum for this study, you need an adequate control group to even begin to understand what these results might mean
Without that, about all we can say is that they made a pretty graph with lines on it
-
-
Note: all of this is independent of whether you like masks! I'm not saying masks don't work, just that this study says nothing about the question
0 replies 0 retweets 15 likesShow this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.