It's striking how similar data engineering infra is to build systems infra: http://bazel.io/docs/skyframe.html … <- could be describing a big data system
-
-
@avibryant how much do you want one? -
@posco we're getting by with Airflow pretty well, but it does seem to me like an S3-native build system would be a much better abstraction.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.