Rich Sutton: The Bitter Lesson that compute always wins: http://www.incompleteideas.net/IncIdeas/BitterLesson.html …
h/t @jachiam0
-
1/2 "The ultimate reason for this is Moore's law"- this is key! Moores law is reaching its inevitable end and if need for AI compute doubles every 3.5 mnths, not quite how long this idea of 'compute always wins' is sustainable for economic & enviromental reasons.
2/2 Computing is 5% of US's energy budget. We simply cannot have that go up by a factor of even 5.
-
-
But if you learned C, your code *could* be 10 times to 100 times more efficient...
#ProfileAllTheThings -
Am sure it does, & so will use of ASIC, novel devices, etc. But simply do not expect the kind of long term sustained improvement Moores law provided. If we were in the beginning of CMOS scaling, then we would have been golden to keep doing this.
- Još 5 drugih odgovora
Novi razgovor -
-
-
Compute chips are becoming specialized for AI and vastly energy efficient. Your assumption is that chips will stay the same which is false.
Hvala. Twitter će to iskoristiti za poboljšanje vaše vremenske crte. PoništiPoništi
-
Čini se da učitavanje traje već neko vrijeme.
Twitter je možda preopterećen ili ima kratkotrajnih poteškoća u radu. Pokušajte ponovno ili potražite dodatne informacije u odjeljku Status Twittera.