interesting to see the divide between people who see GPT3 as a competitor vs people who see GPT3 as a collaborator
15
14
184
Conversation
This Tweet was deleted by the Tweet author. Learn more
here's a bunch of text it generated, that's probably more relevant than technical details anyway:
gwern.net/GPT-3
1
1
6
As someone who works in NLP, I tend to be skeptical of generative models by default. They're entertaining to play with, but eventually the novelty wears off and you realize they're just not good enough. Esp for tasks where correctness is important (summarization, for example).
1
2
fair point. i have the sense from watching other people mess around that GPT-3 might already be good enough to be an “improv partner” in a broad sense - e.g. an assistant for fiction authors who are stuck and need ideas / inspiration - although plagiarism there gets tricky
Yeah, this is a use case that fits well. Generate 20 different paragraphs, see if any of them have a spark of something you'd like to continue with. Models like these will be REALLY interesting once we figure out continuity and common sense reasoning.
3