@moonpolysoft Do you and your crew have horror stories on Apache Apollo? You and yours are pretty good at breaking software.
@KirinDave if your system is idempotent is rescanning every message on boot really that bad though?
-
-
@bascule If you have weeks of data or you can't easily guarantee idempotency.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@bascule Idempotency can be difficult or expensive. -
@KirinDave idempotence is cheap if you can keep track of where you were and ignore what you've already done
End of conversation
New conversation -
-
-
@bascule For example, feeder into a rdb. Rdb has to roll back. It gets tricky. -
@KirinDave yeah, that is a tough case... one I hope we can avoid -
@bascule Roughly time ordered values. Your kafka readers have to be prepared with a "discard before" record in zookeeper. Do that first. -
@KirinDave yeah definitely, that's exactly what I was thinking. It's practically monotonic ;)
End of conversation
New conversation -
-
-
@moonpolysoft@KirinDave lol, so is there a better solution for replaying missed messages? -
@bascule Not replaying missed messages. Being able to rewind to a specific time. -
@KirinDave I don't think we'd ever need to do that... -
@bascule Just gave you an example of where it would be nice.
End of conversation
New conversation
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.