let’s try it! @openAI want to test your full model on those?
@JeffDean want to try? @etzioni @YejinChoinka @ylecun ?
would love to see any general-purpose model (not directly tailored to these examples) that can approach grade-school performance.
open challenge to all.https://twitter.com/sterlingcrispin/status/1188286346487455744 …
-
@GaryMarcus the best way to challenge the field is not to highlight anecdotal examples where current technology fail, however valid they are, but do the hard work and come up with an actual benchmark. Will you take that challenge?
I don't have bandwith to actively run the show myself but made a lot of suggestions here last night & asked for people that might help. Also made a detailed proposal before with @heuristicity a few years back in AI Mag. If your org would like to lend support, it would be great.