@fourbeerspod on the gap between what an experiment did and the verbal explanation given for it.
This is a pervasive problem in most sciences, and more serious than the replication crisis. Even if your facts are right, what do they actually imply?https://fireside.fm/s/Ah1OZyuo+AilLHx9D …
-
-
In fields in which there is not yet a mechanical way of getting results (“normal science”), the productive activity is looking for approaches, ways of framing and thinking the material, developing and evaluating *research programs* rather than theories.
Show this thread -
Research programs consider what technical results *mean*, not just whether they are true. That’s the most interesting and satisfying work, for me personally. And as the
@fourbeerspod guys say, they went into psychology to have Big Ideas, not to test tiny truths.pic.twitter.com/OqpxG6X45q
Show this thread -
(That text block is from my thesis book: https://www.amazon.com/Vision-Instruction-Action-Artificial-Intelligence/dp/0262031817 … )
Show this thread -
What's enraging about the current state of AI is that everyone is treating it as "normal science," i.e. mindlessly turning a publication-generating crank, and deliberately choosing not to ask "what does this mean?" So we don't know; so probably the answer is "not much."
Show this thread -
In addition to the replication crisis, we have a generalization crisis (per the paper of
@talyarkoni which@fourbeerspod discussed). Probably this is as pervasive across sciences, and as misleading, as "most published findings are false." https://psyarxiv.com/jqw35 pic.twitter.com/ymX5RGgvLe
Show this thread -
This can be fixed! It will take serious rethinking of how science is done, and how and why it works. Sciences must continually reflect on whether their current approach/research program is genuinely productive, or meaningless mechanical paper-generation. https://meaningness.com/metablog/upgrade-your-cargo-cult …pic.twitter.com/Q1AERSXSu8
Show this thread -
Research communities should take responsibility for revising their epistemic norms. Psychology has developed a scenius—a creative subcultural ferment that is collaboratively rethinking fundamental assumptions. Yay! The
@fourbeerspod is a great window into the scene.pic.twitter.com/ZiEzdzEaif
Show this thread
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.