Conversation

Just how many people are working in ML research? The sheer pace of new results/capabilities is mind-boggling. I’ve never seen anything like it in any field. A lot of it seems like incremental knob twiddling, but the median results of the twiddling seem non-trivial.
4
87
Must be far from the Pareto. Apparently any near-random tweak to frameworks and training protocols will yield some improvement. So the bottleneck is GPU time it seems.
4
17