@avibryant @wbruce is using it a lot.
-
-
-
@avibryant@wbruce we did a bit but it was too slow for our use case, which is logging at scale….maybe not a good sign for comparison :) -
@chadfowler@wbruce what does "too slow" mean here - latency of a single write? Or can't handle enough parallelism? -
@avibryant@wbruce latency of single write -
@chadfowler@avibryant@wbruce and you switched to Kafka? The operational overhead is a turn off for me. Our ops team is 20% of me. -
@tirsen@avibryant@wbruce no we did not switch to Kafka.
End of conversation
New conversation -
-
-
@avibryant@viktorklang This might be useful, check the refs to http://brandur.org http://www.slideshare.net/petervandenabeele/akka-streams-kafka-kinesis-49863296 …Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant@viktorklang Compare MINIMUM latencies - Kinesis' are high enough it won't work for some of our loads.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant@pandamonial was regaling me with kinesis war stories a few weeks back. Was considering it b4 now looking at mesosphere -
@avibryant@pandamonial 'dcos install Kafka' is appealing for non-critical app
End of conversation
New conversation -
-
-
@avibryant I bet@aconbere or@pavelrepin have things to say about this. -
@zaneshelby@avibryant@pavelrepin I've run both, but I'm much more familiar with kinesis. By and large the core concepts seem to map 1-1. -
@zaneshelby@avibryant@pavelrepin We are very happy kinesis users.
End of conversation
New conversation -
-
-
@avibryant limitations are: 5 read/s/shard and data retention for only 24h. Other than that, it works well.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant we examined Kenesis briefly. For our throughput (250k/sec at peak), it's about 10x more expensive. Charges per "put" -
@avibryant that said, the dev bandwidth consumed by running a Kafka cluster is also quite high.
End of conversation
New conversation -
-
-
@avibryant If you don't have low latency or wide distribution as requirements, Kinesis gets you coding WAY faster. Operationalizing Qs sucksThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant If I understood it correctly it’s a pure streaming solution, no possibility to store data to consume later as in kafka partitionsThanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant we weren't impressed with it. we moved on to NSQ pretty sharpish. dm if you want to speak more.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant I think if I didn't know how to set up Kafka it would be interesting, but Kafka is the more flexible tool.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.