Rich Sutton: The Bitter Lesson that compute always wins: http://www.incompleteideas.net/IncIdeas/BitterLesson.html …
h/t @jachiam0
-
OK, so we want to avoid relying on domain-specific knowledge and instead look for meta-methods that can learn for themselves? All well and good, but these meta-methods (e.g., search) themselves rely on theoretical insight, without which, compute power can't be harnessed.
I agree. That post talks about the unimportance of domain knowledge. But in opinion my AI research is about finding general improvement to algorithm. More compute + better algorithms is behind the success AI imho. Not compute alone.
