Five years ago, I suggested systematically Sokaling all peer-reviewed journals. To “Sokal” is, hereby, to attempt to publish clearly bogus papers to illustrate the brokenness of the academic publication process.https://twitter.com/Meaningness/status/307083846556471297 …
-
Show this thread
-
David Chapman Retweeted Areo
Today @HPluckrose,@ConceptualJames &@peterboghossian reported on the first multiple-Sokaling. They were successful in publishing nonsense in top-ranked journals (which comes as no surprise, but is great to have verified).https://twitter.com/AreoMagazine/status/1047292046073950208 …David Chapman added,
2 replies 10 retweets 76 likesShow this thread -
I had in mind a more ambitious project. Pointing out that “grievance studies” fields are mostly nonsense is shooting fish in a barrel. We know that, for instance, “cognitive neuroscience” is also largely bollocks: https://www.biorxiv.org/content/early/2016/08/25/071530 …pic.twitter.com/mKE8wMuJ9X
6 replies 24 retweets 105 likesShow this thread -
David Chapman Retweeted Brian Nosek
It’s an objective fact that the peer review process isn’t working. We also know, from @BrianNosek’s recent work, that it *can* work, if reviewers are incentivized to make it work. Money is enough, apparently. How about reputation?https://twitter.com/briannosek/status/1034093709971873794 …David Chapman added,
Brian Nosek @BrianNosekUsing prediction markets we found that researchers were very accurate in predicting which studies would replicate and which would not. (blue=successful replications; yellow=failed replications; x-axis=market closing price) https://socarxiv.org/4hmb6/ https://www.nature.com/articles/s41562-018-0399-z …#SSRP pic.twitter.com/4xfv77NFqTShow this thread7 replies 12 retweets 80 likesShow this thread -
David Chapman Retweeted David Chapman
Also in 2013, I suggested that there should be substantial career rewards for successful Sokaling.
There should also be consequences for editors and reviewers that accept demonstrably and intentionally bogus papers.https://twitter.com/Meaningness/status/307084670108053505 …David Chapman added,
1 reply 11 retweets 89 likesShow this thread -
Making Sokaling a routine part of the academic process would go a long way towards fixing it, I think. A few dozen Sokalings are a good start to raise awareness, but if—say—5% of all submitted papers were Sokals, reviewers and editors would become much more careful.5 replies 32 retweets 116 likesShow this thread -
How would this work in practice? A paper would have to be registered as a Sokaling before first submission, along with an explanation of what the author thinks is wrong with it. A cryptographic time-locked database could ensure honesty about this.5 replies 7 retweets 73 likesShow this thread
SOKALING
ON
THE
BLOCKCHAIN 
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.