Writing ingest code is much harder than you would think. (Currently rewriting the entire Reddit ingest module).
Conversation
I presume he's finally going after resolving the spam comments issue that's been plaguing the ingestion for a few months now. for the most part, it's changing the current nature of serializable requests to parallel. and it's likely the trickling is cuz of the spam hitting Reddit.
1
3
That's 100% correct.
Yep. Plan to write up a blog describing the changes and the challenges, etc.
2