LinkedIn's Hourglass looks like a Java-flavored version of the batch parts of @summingbird: http://engineering.linkedin.com/datafu/datafus-hourglass-incremental-data-processing-hadoop …
-
-
Replying to @avibryant
@avibryant@summingbird It looks like Scalding's writeIncremental to me.1 reply 0 retweets 0 likes -
Replying to @Eigenvariable
.
@Eigenvariable@summingbird you know, I'd completely missed the existence of VersionedKeyValSource. Thanks!1 reply 0 retweets 1 like -
Replying to @avibryant
@avibryant@Eigenvariable@summingbird no way! Built on the old marz VersionedStore.java.1 reply 0 retweets 0 likes -
Replying to @sritchie
@sritchie@Eigenvariable@summingbird too bad it isn't more generic about the inputformat (feels like it could be).2 replies 0 retweets 0 likes -
Replying to @avibryant
@avibryant@sritchie@eigenvariable I remember when in 1995 I asked for a feature in some free software. The author replied: "get cracking'"3 replies 2 retweets 1 like -
Replying to @posco
@posco@avibryant@Eigenvariable 2 years, 10,000 lines and 30 monads later, the argument parsing patch was complete :)1 reply 1 retweet 1 like
@sritchie @posco @eigenvariable on the plus side, the entire rest of the system could now be implemented in terms of argument parsing.
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.