Since many of the interesting machine learning papers now regularly required 100s or even 1000s of CPU/GPUs for replication - what strategies are realistically left for startups, public institutions & individuals to do meaningful research in ML?
(a) The GPU cost is still, with rare exceptions, lower than the labor cost. So it's not out of reach, just a question of priorities; and (b) Focus on the (many, many) areas which don't need large compute.
-
-
Computing research is actually rather unusual in historically having labor costs dominate. In physics, chemistry, biology etc the cost of equipment often runs into the hundreds of thousands or millions of dollars, sometimes more.
-
excellent points, thanks!
- 5 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.