Every GPU Google buys is a concession that its TPUs are not good enough. Despite having built 3 generations of TPUs, it continues to buy large quantities of NV GPUs for both internal and public cloud use. This totally breaks the narrative that TPUs will displace GPUs for AI.
-
Show this thread
Replying to @draecomino @jwangark
This is an incredible leap of logic. Most architectures are not worth optimizing for TPUs early on-- nor are most problems of the scale necessary for TPUs. TPUs are incredibly useful, look at training times on recent BERT papers.
10:21 AM - 31 Mar 2019
0 replies
0 retweets
13 likes
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.