Today I typed `r` instead of `R` into my terminal and discovered that `r` in `oh-my-zsh` means "repeat the last command" which had the effect of restarting the ETL routine that took six hours to run, immediately erasing the output on an `open(..., 'w')`.pic.twitter.com/n8gbZ9Y0UF
-
-
Replying to @generativist
This is why when I create large ETL programs like that I generally build in a feature to save the final output to a `.npy` (or similar) and the program will only delete the old file with a `--refresh` or an interactive prompt. Bonus part is that it's faster to load later.
1 reply 0 retweets 1 like
Replying to @TheDataLeek
Unfortunately for me, the last executed program was, $ make rebuild which is my third iteration at this data munging work :(
1:17 PM - 9 May 2019
0 replies
0 retweets
1 like
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.