Conversation

critiques i get from ppl who don't know stats: "Selection bias! Internet surveys aren't 'studies'! Just Aella's Audience!" from ppl who do know stats: "You should try [different new statistical method] instead, would account for [obscure math thing I need to go learn now]"

458

Aella

@Aella_Girl

Critiques from ppl who are v familiar with stats are typically actionable - they're recommending I go learn a new method or technique, trying to explain why it's the appropriate move here. Critiques from n00bs are always like "give up and stop trying, you're fundamentally flawed"

4:23 PM · Jan 31, 2023

20.6K

Views

Replying to

The point is that there is no statistical method to get over selection bias. Like most internet surveys, yours is not capable of inferring to the broader population, just your audience. The solution is to accept this and adjust your claims accordingly.

Replying to

I have never claimed it to be definitely representative of the general population!

Replying to

true in many domains, not just stats make positive suggestions for actionable alternatives or get off my game board

裴勇俊 (Customer Not Product)

@PrinceTeleporno

Jan 31

Replying to

@Aella_Girl

They are kindly recommending the strategy that worked so well for themselves🤣

Replying to

Always get a good chuckle when people are bothered about sample size on studies with 1000’s of participants and few factors.

@c8h11no2_njoyr

Jan 31

Replying to

@Aella_Girl

this is the way the internet always is. amateurs chiming in when on the peak of the dunning-kruger curve

Replying to

I'll take incomplete data over no data as long as we're all clear about it and don't go out over our skis.

Replying to

If they cared so much they should do the research themselves. They don’t, and you should follow suit, not caring about their thoughts and/or publicly humiliate them. 🤷🏻‍♂️

Replying to

Pointing to selection bias is an actionable critique!

Replying to

I mean how else are you supposed to gain data 😂. One of my professors had us post shit on Reddit or twitter but literally both these places are being selected so of course there’s bias 🤣