I'm experimenting with automatic lineage tracking in R: https://github.com/jwills/lineage Thinking in monads actually helps a lot. #shock #rstats
-
-
@avibryant@josh_wills in particular, as far as I can tell, Samza is a pure analog of Hadoop madreduce for queues. /cc@jaykreps -
@posco@josh_wills@jaykreps and Kinesis is basically AWS Samza. But Spark Streaming is also a planner, no? -
@posco@josh_wills@jaykreps also, check out how Samza does state; there's some interesting stuff there that goes beyond "streaming MR".
End of conversation
New conversation -
-
-
@posco@josh_wills I feel like everyone's dancing around pieces of the same problem but there's very little shared vocabulary. - 1 more reply
New conversation -
-
-
@avibryant@josh_wills I think summingbird is an API and planner/optimizer, the rest are platforms for streaming compute.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.