@fourbeerspod on the gap between what an experiment did and the verbal explanation given for it.
This is a pervasive problem in most sciences, and more serious than the replication crisis. Even if your facts are right, what do they actually imply?https://fireside.fm/s/Ah1OZyuo+AilLHx9D …
-
-
The parts of psychology that are most in trouble have dutifully tried to make and test theories, because that’s the folk model of Real Science, but adequate tools were unavailable. Cog psych (like molbio) tries to make mechanisms visible; that is more feasible there.
Show this thread -
In fields in which there is not yet a mechanical way of getting results (“normal science”), the productive activity is looking for approaches, ways of framing and thinking the material, developing and evaluating *research programs* rather than theories.
Show this thread -
Research programs consider what technical results *mean*, not just whether they are true. That’s the most interesting and satisfying work, for me personally. And as the
@fourbeerspod guys say, they went into psychology to have Big Ideas, not to test tiny truths.pic.twitter.com/OqpxG6X45q
Show this thread -
(That text block is from my thesis book: https://www.amazon.com/Vision-Instruction-Action-Artificial-Intelligence/dp/0262031817 … )
Show this thread -
What's enraging about the current state of AI is that everyone is treating it as "normal science," i.e. mindlessly turning a publication-generating crank, and deliberately choosing not to ask "what does this mean?" So we don't know; so probably the answer is "not much."
Show this thread -
In addition to the replication crisis, we have a generalization crisis (per the paper of
@talyarkoni which@fourbeerspod discussed). Probably this is as pervasive across sciences, and as misleading, as "most published findings are false." https://psyarxiv.com/jqw35 pic.twitter.com/ymX5RGgvLe
Show this thread -
This can be fixed! It will take serious rethinking of how science is done, and how and why it works. Sciences must continually reflect on whether their current approach/research program is genuinely productive, or meaningless mechanical paper-generation. https://meaningness.com/metablog/upgrade-your-cargo-cult …pic.twitter.com/Q1AERSXSu8
Show this thread -
Research communities should take responsibility for revising their epistemic norms. Psychology has developed a scenius—a creative subcultural ferment that is collaboratively rethinking fundamental assumptions. Yay! The
@fourbeerspod is a great window into the scene.pic.twitter.com/ZiEzdzEaif
Show this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.