Considering that random forests have many layers and beat deep learning in most applications, maybe we just need to rebrand them as deep forests and they'll be the next big thing.
-
At one point I actually agreed with you that traditional methods were undervalued. The last ~three years, BERT, GPT-3, seeing the massive upscaling of compute in industry changed my mind. Nobody is advocating that we ignore history, but that we not be beholden to it.
