Emil O W Kirkegaard

Obviously, Sokaling would have to be done by humans to be truly effective rather than by relying on some machine-generated approach (and these humans would need to be incentivized, by concrete academic benefits and so on)...

Obviously? Why?

Because good papers are also written by humans and not machines... I'm not against machine-generated Sokaling, I just don't think it will be equally effective.

Indeed. Good papers are written by humans. If your journal is incapable of passing this reverse Turing test it rather proves the point.

Okay, let's compromise and say that both approaches would be good to try.

O ye'll tak' the high road, and I'll tak' the low road, And I'll be in Scotland a'fore ye But, yes, the more Sokaling the better.

That said, I expect the response to current and future Sokaling attempts will be to circle the wagon. Journals will grow more insulated, accepting only papers from those who have been *properly* initiated. Monte Carlo generators allow people outside the peer circle to judge.

I think insularity increase as a response to demand for rigor is definitely very likely, but insularity being a cultural thing, it will probably take at least a decade or two to take hold.