The Azkaban workflow scheduler is literally the most important tool I use on a regular basis. http://azkaban.github.io/azkaban2/
-
-
@avibryant Haven't worked w Luigi, but FWIW, Azkaban has a great UI, reasonable reporting of task metrics, and handles failure elegantly.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant Building Azkaban job files manually can be cumbersome, so we've build an internal Ruby tool to assemble them from a DAG spec.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant Azkaban also has really excellent historical reporting - very easy to step back through prior executions & inspect logs.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
@avibryant Az also lets you navigate HDFS in the browser, w/ plugins for viewing compressed JSON / Avro through the web interface.Thanks. Twitter will use this to make your timeline better. UndoUndo
-
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.