One million tweets processed in ~30 seconds.
github.com/pushshift/ndjs
Conversation
Replying to
947 whole bytes tho.
What if you initialise chunk as null str?
then u can do "if not chunk:" can't u?
🤣
1
1
No seriously tho, love it but I won't try this on my 2009 dell with centrino
Replying to
Could always use jq with gnu parallel if you want a clean, bash-only solution.
1