Many people think “peer review” means “independent replication and confirmation of results” It usually means months of delay while a few folks in your field write an email-length criticism of the paper and ask for more work. More like code review, at best. Not a panacea. https://twitter.com/johnmyleswhite/status/1258207942509309956 …
-
This Tweet is unavailable.Show this thread
-
I do want to see a preprint server that adopts GitHub & Bitbucket as their backends, and sets up Jupyter, Sweave, org-babel, or something like that as a reproducible research build framework. Then peer reviews are actual pull requests, rather than comments on a static PDF.
20 replies 29 retweets 168 likesShow this thread -
Replying to @balajis
The value of peer review is to filter out a lot of really dubious crap. Think of a spam filter, not a team of scientists replicating every experiment. Remember the paper a million years ago (aka weeks) that hinted SARS-CoV-2 included pieces of HIV? Spam.
6 replies 4 retweets 55 likes -
Replying to @matthew_d_green
Extending the analogy, the cost of that spam filter is months of delay on every other manuscript. And the peer reviews for that paper came out right away, on Twitter, and we critiqued it very quickly. I don't think the old style of pre-publication review serves us very well.
5 replies 0 retweets 14 likes -
Replying to @balajis @matthew_d_green
It's both broken but much less broken than most other versions of the same problem. Twitter peer-review is fine for those who spend a lot of time curating their own experts along with some expertise to gauge the conversation. I'm liking preprint open review plus peer review tbh.
1 reply 0 retweets 6 likes
zeynep tufekci Retweeted zeynep tufekci
The open preprint got ton of interesting feedback (the comment stream on the site is mostly junk, though) and some very useful criticisms—but also a lot of nonsense ones. And we'll get some official peer-review results, too. Good process for the moment.https://twitter.com/zeynep/status/1257297567995617283 …
zeynep tufekci added,
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.