In fact, it appears as if the main finding of this paper completely contradicts the results of this analysis. There does not appear to be any statistically significant differences in the reported values when comparing lean and obese people at all!
-
Show this thread
-
Now, that's pretty bad. But it gets worse This study was probably not designed to test the question of obese vs lean How do we know? Look at the sample size calculationpic.twitter.com/NtOj1k7zwi
4 replies 2 retweets 34 likesShow this thread -
So, they've computed their sample size based on the idea that they want to detect an effect size of 0.25 between two groups But...they didn't include any indication of obese vs lean here. The eventual sample size (150) shows us that
2 replies 3 retweets 30 likesShow this thread -
Instead, it seems almost certain that the original study just looked at lying in fasted vs breakfasted people We can actually see this even more clearly because they ran 36 people through the entire procedure only to exclude them after the fact!pic.twitter.com/YcaJhAfNFh
1 reply 4 retweets 51 likesShow this thread -
This starts to get a bit murky, because I cannot find a pre-registration for the study That's worrying, because changing your hypothesis after running a study is a classic sign of p-hacking
2 replies 3 retweets 82 likesShow this thread -
Another sign is the statistical analysis. I count upwards of 100 comparisons (Fisher's exact test, chi squared etc) with no correction for multiple comparisons That's...worrying
1 reply 3 retweets 52 likesShow this thread -
If you apply a Bonferroni correction to the results, pretty much every statistically significant finding completely disappears, which is not surprising given that they ran SO MANY tests
1 reply 2 retweets 44 likesShow this thread -
Bringing it back home, we have this sentence in the discussion According to supplementary table 4, this simply isn't true!pic.twitter.com/zNm5GfENI8
1 reply 4 retweets 33 likesShow this thread -
Obese people had differences in behaviour, but the statistical comparisons DIDN'T SHOW A SIGNIFICANT DIFFERENCE Pretty major issue, that
1 reply 3 retweets 54 likesShow this thread -
Anyway, the paper is abhorrent regardless, but I think it also shows some worrying signs of being constructed after the fact from a dataset of a trial with different aims
1 reply 5 retweets 63 likesShow this thread
Oh, another issue - the paper makes an inherently misleading claim about causality. The primary findings were of a subgroup analysis of non-randomized groups (lean vs obese) and so it's not clear whether this was causal anyway
-
-
Because the randomization was simply fasted vs breakfast, the causal attribution for this study should be comparing those two groups, not the subgroups of obese vs lean
6 replies 3 retweets 59 likesShow this threadThanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.