Conversation

This Tweet was deleted by the Tweet author. Learn more

Replying to

@jasonbaumgartne

Hi Jason! Do you have a citation you can point me to that shows how you do this? We have a purchased set from the same time. Would be happy to compare...

1

5

JSON Baumgartner

@jasonbaumgartne

Replying to

Methodology is here:

docs.google.com

Reconstructing Twitter's Firehose

Reconstructing Twitter's Firehose How to reconstruct over 99% of Twitter's firehose for any time period Author: Jason Michael Baumgartner (Creator of Pushshift.io) E-mail: jason@pushshift.io Twitter:...

2:12 AM · May 12, 2019Twitter Web Client

Replying to

@jasonbaumgartne

Thanks!

1

1

Replying to

and

@jasonbaumgartne

Ya, that’s awesome. So, you identify a subset of likely IDs (reverse engineering their ID production method) and then brute force ID calls and filter against that… is that a correct (super simple) interpretation?

1

2

Show replies

JSON Baumgartner

@jasonbaumgartne

Replying to

@jasonbaumgartne

and

I also have some Python code already written to handle this if you are interested in reviewing it.

1

Miguel de Icaza

Replying to

@jasonbaumgartne

and

That was an excellent post

1

1

JSON Baumgartner

@jasonbaumgartne

Replying to

and

Thank you. Glad you found it helpful