Conversation

critiques i get from ppl who don't know stats: "Selection bias! Internet surveys aren't 'studies'! Just Aella's Audience!" from ppl who do know stats: "You should try [different new statistical method] instead, would account for [obscure math thing I need to go learn now]"

458

Replying to

The results are interesting and fun. But most readers make inferences about the broader population which makes selection bias is an issue. Saying it's only "Aella's audience" helps but doesn't solve it: it's some subset who choose to answer for diverse and unknown reasons.

Replying to

this would piss me off less if I saw the same critiques directed as much towards the majority of published, peer reviewed academic research that comes from surveys, which have *way* less representative samples than I do. The discrepancy in critique makes me think I'm targeted.

Tailcalled (tailcalled@schelling.pt)

Replying to

and

Have you tried describing some peer-reviewed research to your followers to double-check that they have different reactions to that?

Replying to

and

maybe I should pretend I did some research that's actually directly lifted from something published to test this

2:16 AM · Feb 1, 2023

573

Views

Likes

Tailcalled (tailcalled@schelling.pt)

Replying to

and

I was more thinking the opposite side of the test. Your complaint seems to be assuming that people react specially to your research because it's not peer-reviewed, but it might be that people dismiss peer-reviewed research too if the details are described.