Conversation

This Tweet was deleted by the Tweet author. Learn more

Thanks so much for writing this up so clearly with code illustrations! I modified it a little to listen to the sample stream and keep track of unique servers seen. I only ran it for a few minutes but it looked like it stabilized at 20?

Quote Tweet

Ed Summers

@edsu

Feb 27, 2019

Here's a small modification to the supplied code to connect to the filter stream using twarc and print out the deconstructed snowflake ids in real time. It also keeps track of the number of unique data center, machine and server ids seen. gist.github.com/edsu/2f48afe80

Show this thread

Replying to

Yes -- 20 is usually the max number of machine ids that I see in play at any given moment. When I ingested tweets from 2014 related to Robin Williams death, there were 17 machines active at the time. One important step that I need to add to the paper is doing a pre-scan for ...

Replying to

and

..the time period you will be ingesting. The pre-scan would cycle over all 1024 possible machine ids to find the ids that were active for a specific time period. This pre-scan would run for 15-30 minutes and then at that point, you would have the machine ids in play at that time

8:46 PM · Feb 27, 2019Twitter Web Client