Jennifer Trueblood: ideas for improving cognitive modeling: make models available, report models that do not work as well, detailed evaluation of models #iccmpsyched
-
-
Trueblood made very clear that not all work can or should be pre-registered and that exploratory work is essential. She presented this mostly in the context of pitching existing models against each other and/or using computational models as measurement tools.
-
That's fair. I'm genuinely interested how you can preregistrer a computational experiment though in any context.
-
I feel strange speaking for her but I don't think she's on Twitter. Her keynote yesterday was an example (she said) of work that could have been pre-reg'ed b/c they sat out to test a set of models on a number of datasets.
-
Fair enough. My flight to Madison just got cancelled so I might not get a chance to ask her.

-
I wasn't expecting you to speak for her BTW. I was asking you.
-
And indeed anybody who wants to join in.
End of conversation
New conversation -
-
-
One way I know is constructing the model before data collection, running simulations, registering the results and then collecting the data. After that, tweaking the parameters for a better fit, if it is necessary.
-
Not all comp models use data.
-
But yeah, that's legit.
-
I'm not sure I'd call that pre-registering the models though. I think that's just the normal way to use models correctly. The model essentially pre-registers the experiment.
-
I agree it is the correct way unless the goal of the model is to provide an explanation for existing data. I couldn’t understand why the correct way of modeling can’t be called pre-registration though.
-
Sure I agree it can be called pre-registration.. but I don't think the model itself is pre-registered. That phrasing suggests to me that you state in advance how you will build the model. I don't quite understand how that would look or work.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.