Writing ingest code is much harder than you would think. (Currently rewriting the entire Reddit ingest module).
Conversation
I presume he's finally going after resolving the spam comments issue that's been plaguing the ingestion for a few months now. for the most part, it's changing the current nature of serializable requests to parallel. and it's likely the trickling is cuz of the spam hitting Reddit.
1
3
Yep. Plan to write up a blog describing the changes and the challenges, etc.