Nothing wrong with retrospective observational trials, but it means we have to be REALLY cautious about causal conclusions
-
-
Remember, these were VERY sick people. In groups admitted to an ICU for
#COVID19, the median death rate is usually around 30%Show this thread -
The authors have constructed an arbitrary ordinal scale here from 1-6, where 6 is the worst (death) and 1 is the best (discharged) Based on this scale, most patients improved on remdesivirpic.twitter.com/UtcUDlTvzX
Show this thread -
HOWEVER, there was a huge issue here Most patients didn't have the follow-up required to perform this calculation. In fact, based on the IQR presented here, less than 25% had 28 days follow-up data to analyze!pic.twitter.com/asI1gDSlEV
Show this thread -
Younger people did better than older, people who were not mechanically ventilated did better than those who were (not surprising perhaps)pic.twitter.com/2gHltBjWHt
Show this thread -
There were also a large number of reported side-effects, although given the lack of a control group and how sick these people were it's very hard to know if they had anything to do with remdesivirpic.twitter.com/9YS5cmlhxm
Show this thread -
As a fun statistical point, the confidence intervals for some of these regression analyses were, uh, pretty wide Older patients had between 35% and 9417% increase risk of death!pic.twitter.com/HMsGPPYXfs
Show this thread -
So what does this all mean? Well, the authors talk about it in their discussion Apparently, the mortality rate was lower than expected, which is "noteworthy"pic.twitter.com/VCSblvjbs5
Show this thread -
Now, I'd argue that this is...problematic It is extremely difficult to compare patients across trials, and absolutely NOT best practice We also saw a high dropout rate in the trial, with 20% of patients not receiving the complete treatment!https://twitter.com/GidMK/status/1249547200834580485?s=20 …
Show this thread -
We also have very few patients in this trial, and no control group Also, the patients were selected by their doctors - perhaps picking the patients that they thought had a fighting chance? We can't really say whether the death rate was low or high from the data we have!
Show this thread -
To the author's credit, the final paragraph acknowledges most of this!pic.twitter.com/0TdO2drS1C
Show this thread -
Let's sum up:
very small retrospective trial
no control group
written by pharma funder
high dropout
short timeframe
missing data
poorly written/edited
somewhat odd stats
highly selected patient cohort
no causal conclusions!Show this thread -
Basically, it was a very small study with HUGE caveats that showed an interesting possibility Hard to say anything more than that without a proper trial of some kind
Show this thread -
Some might argue that this should not have been published as a research trial, given the many caveats and huge conflicts of interest this study seems to contain I guess that's a question for
@NEJM, who appear to have garnered millions of reads on the article in the last few daysShow this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.