Conversation

New paper by

and me in

offers a case study from reddit for estimating missing data in online behavioral datasets: "the validity of computational social science depends on the integrity of the data"

journals.plos.org

Caveat emptor, computational social science: Large-scale missing data in a widely-published Reddit...

As researchers use computational methods to study complex social behaviors at scale, the validity of this computational social science depends on the integrity of the data. On July 2, 2015, Jason...

Replying to

and

Nathan and Devin are personal friends of mine and I did lend assistance in the beginning stages of this paper. For the record, I never considered this an attack on my work but a perfect example of why peer review in academia is so important to keep things advancing forward.

4:33 PM · Aug 10, 2018Twitter Web Client

Replying to

I've learned some valuable lessons about how to temper claims with adjectives such as "all" or "every" when describing a massive data set. Also, the work led to recapturing a lot of the missing data! If you're a researcher -- trust, but verify!

This Tweet was deleted by the Tweet author. Learn more

Replying to

Pack it up guys -- we get to leave shop early today.

Replying to

This paper is more of a caution for scientists who use

@pushshift

data to draw conclusions rather than a shortcoming of your service. We have seen this happen with other datasets too, for ex Twitter : arxiv.org/abs/1306.5204 Thanks for your data service!