Here's how we reduced @apachekafka disk and network usage 4.5x on a cluster with 100Gbps of just ingress bandwidth:https://blog.cloudflare.com/squeezing-the-firehose/ …
Thanks for clearing that up! I looked at the code and it's recursiveness of message sets that got me confused. Please take another look at the blog post, it should be correct now.
-
-
Thanks for updating. It is better, but perhaps needs a few more edits still. I agree that the previous code was very confusing. I am very glad that the code for the 0.11.0 message format is easier to follow.
-
The 0.11.0 message format is a bit more efficient, but the biggest gain is for the uncompressed case since compression mitigates some of the inefficiency.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.