JavaScript is not available.

Jan 24, 2021

Mass Judgment & Decision Making replication & extensions project [Updated] 72 completed (+13 ongoing) + 13 RRS1 Project: mgto.org/pre-registered 2020: mgto.org/hkuprojects2020 2019: mgto.org/hkureplication Pubs&preprints: mgto.org/pre-registered Join: mgto.org/joinmassreplic

GIF

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Science Europe

@ScienceEurope

Off to a good start! The Science Europe Working Group on #OpenScience held its first meeting of 2023. This year's focus will be on mutual learning and policy alignment between our research funding and performing members: scieur.org/open-science-d #RoadToOpenScience

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Ian Hussey

@ianhussey

Replying to

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Follow up thought: because these questions related to the intersection of experimental paradigms and measurement, and experimental work tends to ignore measurement, I would guess a lot of this is myth and lore rather than evidenced.

Replying to

Cool graphs, the violin plots!

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

LMU Open Science Center (@lmu_osc@scicomm.xyz)

@lmu_osc

Feb 1

Join to hear perspectives from - Coalition for Advancing Research Assessment

@CoARAssessment

@MostlyPhysics

- DFG

@dfg_public

by Dr Grimm - Univ. applied sciences

@EAHJena

by Prof Mitte - Early-Career Researchers by @JLRohman - Learning-society

@DGPs_Berlin

@nicebread303

Quote Tweet

LMU Open Science Center (@lmu_osc@scicomm.xyz)

@lmu_osc

Feb 1

Join our free hybrid symposium !

Reforming Research Assessment: how to implement responsible procedures and move beyond impact factors and h-index?

13.03.2023, 14:30-16:30

Munich and Zoom

osc.uni-muenchen.de/news/symposium

We will hear short presentations from
Prof Dr Toma Susi (CoARA Steering Board Member) on Agreement and the Coalition for Advancing Research Assessment;
Prof Dr Kristin Mitte (Vice President Research & Development, Ernst-Abbe-Hochschule Jena) on on how societal impact and translation of research constitute important evaluative dimensions in the applied sciences;
Dr Tobias Grimm (Head of Division Life Sciences II, German Research Foundation (DFG) head office) on the DFG’s approach to reforming research assessment;
Dr Jess Rohmann (Head of the Scientific Directorate Office at the Max Delbrück Center in Berlin) on the perspective of Early-Career Researchers and a history of actions taken in Berlin Institutions;
Prof Dr Felix Schönbrodt (Managing Director of the LMU Open Science Center) on the Deutsche Gesellschaft für Psychologie’s working group proposal for practical implementation, for the field of psychology in Germany.
Dr Heidi Seibold will chair the panel discussion.

read image description

ALT

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Wolfgang Viechtbauer

@wviechtb

The 2023 Evidence Synthesis and Meta-Analysis in R Conference (#ESMARConf2023) will take place March 27-31. The conference is free. Details here: esmarconf.org. On March 24th, I will give a free pre-conference workshop on meta-analysis with R: wvbauer.com/doku.php/works

esmarconf.org

ESMARConf

ESMARConf is a FREE, online annual conference series dedicated to evidence synthesis and meta-analysis in R. Our aim is to raise awareness of the utility of Open Source tools in R for conducting all...

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Hu Chuan-Peng | @hcp4715@mastodon.online

@hcp4715

What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in...

computational reproducibility is hard. Great to see Psych Sci published a meta-research that checked this issue among papers published in it w/ open data badges. Results: only 1/14 was rated "exactly reproducible" may be of interest to

@russpoldrack

journals.sagepub.com

In April 2019, Psychological Science published its first issue in which all Research Articles received the Open Data badge. We used that issue to investigate th...

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Mahmoud Elsherif @mamsmandrill@mastodon.world

@MamsMandrill

Very upset to leave

@UoB_SoP

, meeting and working with fantastic individuals. However, absolutely delighted to be joining

@UoL_Psychology

as a Leverhulme Early Career Research Fellow, working with the amazing

@kbp3

on linguistic prediction in the ageing brain!

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

F Rodriguez-Sanchez

@frod_san

GitHub - gavinsimpson/physalia-multivariate: Multivariate analysis of biological data

Three very helpful free resources to learn about multivariate statistics & data analysis with #rstats:

@ucfagls

course: github.com/gavinsimpson/p

@zdealveindy

online book davidzeleny.net/anadat-r

@plbuttigieg

guide: sites.google.com/site/mb3gustam

github.com

Multivariate analysis of biological data. Contribute to gavinsimpson/physalia-multivariate development by creating an account on GitHub.

116

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Dr Elsje van Bergen

@drElsje

Introduction - beginners-guide

🇳🇱🎓Academics who are new(ish) to the Netherlands, or consider moving here, see this beautiful guide by

@DeJongeAkademie

to support you in the Dutch funding system and research & teaching culture knaw.h5mag.com/beginners-guid

In this edition: A beginner’s guide to Dutch academia This guide, an introduction to Dutch research and higher education, serves as a support document for researchers and instructors who are unfami...

124

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Josh Payne

@JoshSPayne

Replying to

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Honestly don’t think it’s something that is well thought about. I am not sure it’s been that robustly examined in cog sci in any detail for the questions you’re asking. Local knowledge with I guess the need for a task that doesn’t share the same or competing stimuli/response sets

Replying to

and

The line between “filler task” and an extra IV/DV/mediator/moderator if we need it for p hacking seems very fine at times.

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Ian Hussey

@ianhussey

Replying to

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Very interested in this. The multi site RRR I co-organised involved two filler tasks and their assumptions were wild to me. They simultaneously were argued to be irrelevant and were barely discussed and yet their content had theoretical overlap i found suspicious.

Nedra Weinreich

@Nedra

Replying to

Great questions!

This seemed rather straightforward experimental design, fairly simple ideas, yet to articulate them well was a long effortful process.

@adfillon

did great job working to make it stronger. 🙏 Grateful for feedback, & made many changes to improve. Feedback welcome & appreciated!

Revised preprint: "Asymmetries in attributions of blame and praise, intent, and causality: Free will, responsibility, and the side-effect effect" Received peer review feedback. Did overhaul. More detailed & clearer now. PP: researchgate.net/publication/35 OSF: osf.io/z3g6d/

Quote Tweet

Dec 7, 2021

New preprint: "Asymmetries in attributions of blame & praise, intent, & causality: Free will, responsibility, & side-effect effect" Great team @adfillon & @PRASAC with interesting findings. Preprint: researchgate.net/publication/35 OSF: osf.io/z3g6d/

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Jadrian Wooten

@Wootenomics

20h

We spent hours watching

@MrBeast

videos & writing lesson plans for your economics classroom! I am excited to present a working paper, co-authored with

@WayneGeerling

and

@DirkMateer

, that explores the use of three of MrBeast's most well-known. 🔗: papers.ssrn.com/sol3/papers.cf

119

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Peter is in Oxford Feb 6-13

@peterwildeford

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Great work from the

@RethinkPriors

survey team and General Longtermism team exploring public support for UV light to improve indoor air quality forum.effectivealtruism.org/posts/2rD6nLqw

Denis Wirtz

@deniswirtz

UPDATED: our massive database of PhD fellowships is available for download. We list 195 different fellowships with description of the award, eligibility criteria, deadline and amount. Download for free here: research.jhu.edu/rdt/funding-op

UCLA and 9 others

1,509

3,267

There must be some big literature on this I'm missing. Please help guide me. Any references or guidance regarding this big often overlooked and poorly documented unknown?

3rd, what makes for a good filler task? what makes this filler the right filler task here? This is never discussed, how did you decide on this filler task? why this and not something else? etc. etc. etc.

2nd, papers never state assumptions or need for filler task. - Do they help with hiding study purpose? - Assumption they have no impact on DVs. Really? How do you know? - Are they really disconnected from IVs? how do you know? Yet to see empirical tests with/without fillers.

1st, most important for replications, no one ever states what the filler tasks are. When we don't include them, reviewers say - but you must have one for a direct replication. Let's say they right (I don't think they are), then =which= filler task? These can really go sideways.

== Request advice on filler tasks == What are good cites about the role and value of filler tasks, why they're needed, how to construct them, etc? Having done many replications, I baffled by many filler tasks practices & assumptions. 👇🧵

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Steve Stewart-Williams

@SteveStuWill

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

How the world has changed over the last century. A compilation of some of our greatest accomplishments as a species. Credit:

@toddrjones

toddrjones.com/dataviz/

0:56

303.3K views

From

Pascal Bornet

1,623

4,672

Bradley J. Baker

@BradleyJBaker

What’s in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in...

Academic journals have responded to the replicability crisis by promoting open science, including through awarding badges, for example for providing open access to data. How well do these badges work? That’s what we tried to find out! doi.org/10.1177/095679 🧵1/

journals.sagepub.com

In April 2019, Psychological Science published its first issue in which all Research Articles received the Open Data badge. We used that issue to investigate th...

154

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Ines Perpetuo, PhD

@ines_perpetuo

Academia’s culture of overwork almost broke me, so I’m working to undo it

A good reflective piece of reading for Friday... "I now realize that, by hiding behind passion, I was excusing my contribution to a toxic burnout culture in research. "

nature.com

Nature - For young immigrant women like me, the pressures of early career research are even greater than for most. But it doesn’t have to be that way.

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Replying to

and

Yes please, either tweet them, DM me with them or send to admin@predatory-publishers.com

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Replying to

Independent replication is the bazaarly missing foundation from science today. If you’re a serious science - you have to be able to handle and actively want the truth. Which can only be found beyond the walls of your lab.

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Charlotte Pennington

@drcpennington

Feb 2

"The replication crisis should be taught as an essential component of the undergraduate psychology curriculum" Read my thoughts on this in a new

@OpenUniPress

@MHEducation

blog post! [6 min read] tinyurl.com/drcpennington #Replication #OpenScience #OpenResearch

Two trees shaped into human heads, with full leaves on each tree creating a complete jigsaw puzzle when put together.

read image description

ALT

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Charlotte Pennington

@drcpennington

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Having just taught a Year 1 seminar on replication and open science, I can vouch that our UGs really enjoy it! It allows them to become critical consumers of science, understanding reasons why studies may or may not replicate. Their questions were top tier, too! 🤩🤩

Quote Tweet

Charlotte Pennington

@drcpennington

Feb 2

"The replication crisis should be taught as an essential component of the undergraduate psychology curriculum" Read my thoughts on this in a new @OpenUniPress @MHEducation blog post! [6 min read] tinyurl.com/drcpennington #Replication #OpenScience #OpenResearch

read image description

ALT

Center for Adaptive Rationality (MPIB, Berlin)

@arc_mpib

Summer Institute on Bounded Rationality

🚨Applications now open for this year’s Summer Institute on Bounded Rationality! 🚨

Quote Tweet

@sibr2023

APPLICATIONS FOR THE 2023 SUMMER INSTITUTE ARE NOW OPEN! We're very excited to announce that this year's Summer Institute on Bounded Rationality will focus on the Science of Boosting. For more info and to apply, please visit: mpib-berlin.mpg.de/research/resea

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Heather Urry

@HeatherUrry

formr - an online survey framework with live feedback

HELLO. I'm here to give a major shout-out to Ruben Arslan (

@rubenarslan

) and Cyril Tata (

@cyriltata

) for the formr survey platform. Incredible! Successfully used it to launch a project on emotion in daily life, w/ personalized feedback and SMS cuing!!

formr.org

formr survey framework. chain simple surveys into long runs, use the power of R to generate pretty feedback and complex designs

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Daryl Cameron

@DCameron84

An Online Gathering for Moral Psychology* Spring 2023 Friday, March 3rd: 4:00pm to 7:45pm (EST) Zoom Link: https://cofc.zoom.us/j/92712894060 Eric Schwitzgebel (UC Riverside, Philosophy) at 4:00 pm...

Spread the word -- the Moral Psychology Research Group, a cross-institutional group of moral psychologists and philosophers I'm part of, is hosting its first online conference on March 3-4, organized by Thomas Nadelhoffer. Free to attend, please RT! 1/2

sites.google.com

MPRG - Online Events

103

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

Margaret Echelbarger

@tweetsbymidge

Being prosocial is good for our well-being, yet we're often reluctant to engage in direct prosocial actions. Why? In this new Current Dir in Psych Sci paper, Nick Epley, Amit Kumar, James Dungan, & I argue that miscalibrated expectations get in the way.

@sbucob

@CDR_Booth

🧵

Screenshot of top of journal article "A Prosociality Paradox: How Miscalibrated Social Cognition Creates a Misplaced Barrier to Prosocial Action." The authors are Nicholas Epley, Amit Kumar, James Dungan, and Margaret Echelbarger. The article is published in Current Directions in Psychological Science. The abstract and author affiliations are also included.

read image description

ALT

164

Gilad Feldman (@giladfeldman@fediscience.org) Retweeted

New

discussion paper (No. 15!), by

@davidroodman

: a comprehensive robustness replication of Esther Duflo's seminal paper on school construction in Indonesia. Beyond this study, a lot to learn for similar DiD & quasi-experimental approaches. econstor.eu/bitstream/1041

“Check me, replicate me” pledge - Promoting collaborative replicati...

If you want to know more about that, see my talk on the pledge on:

youtube.com

This is an online/remote talk given at University of Vienna on March 31, 2022, by Gilad Feldman.Slides: https://mgto.org/2022viennaChapters:00:00 Opening not...

Check me, replicate me: Corrections & replications of my work

Grateful for him sharing regardless. I hope there soon comes a time when we see the value in & support others who dedicate their time & resources to help us validate, check, & extend our work. Hope to see others support "check me, replicate me" pledge:

mgto.org

Please help me do better science!Jump to: What I offer / I'll pay you / Payouts so far / Corrections of my work / Replications of my work / Questions about my work / Related readings & initiat

Requested materials from original author. He was very kind, responded fast with all materials, data, & code. 👏🙏 He added: "I am not interested in spending more time on your effort. I have reservations about whole business of wholesale replication of the sort that you do." 🤷