2/ e.g. Why weren't pretrained Unets or transfer learning employed in GANs in late 2018 for GANs? Probably simply because nobody else was doing it- lack of social validation. It certainly wasn't hard to come up with a proof of concept, especially for a fresh MOOC grad like me.
-
-
Show this thread
-
3/ Same thing seems to have happened with NLP and transfer learning- see ULMFiT and the resulting NLP revolution. You can even say the same thing for neural networks themselves. They didn't even teach them when I took my computer vision and AI university classes in 2004-2005.
Show this thread -
4/ Since then, time and time again, it has paid off for me, big time, to simply remember to look where others aren't looking, and to prioritize actual observation over trying uncritically assume that smarter people have already covered the territory and are right.
Show this thread -
5/ I just find this incredibly interesting- the subject of how exactly progress in science, tech and culture -actually- happens. I think it has a lot more to do with being ok with "oopsies", asking the right questions, and exploration rather than trying to be right and clever.
Show this thread
End of conversation
New conversation -
-
-
Where's the talk at?
-
It won't be public unfortunately.
End of conversation
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.