Thanks for pinging me yesterday about the ingest issues. The ingest itself was working fine but there were network issues between the ingest server and the ES ingest server that caused a delay in indexing. It should be caught up now!
Conversation
Replying to
Yeah turned out better than expected as all the comments I assumed were lost were there after all.
1
1
Replying to
The ingest server has a buffer (Redis) for two million comments -- so it can hold a little less than a day's worth of data. I will probably bump it up to 5 million just to be extra safe.