Interesting that DeepMind is working on a IQ-like test to measure abstract reasoning capabilities. I've been working on a very similar benchmark for the past 6 months (taking a more formal approach). Good to see more action in that space (cc @ChrSzegedy)https://deepmind.com/blog/measuring-abstract-reasoning/ …
-
-
My tests are based on colorful little matrices like these. I expect to release the full dataset and associated paper by the end of 2018. Should have happened much earlier, but Keras development is taking up a lot of my time.pic.twitter.com/mPjxgB1TFW
Show this thread -
For more context about why we need such a benchmark, see my talk at RAAIS 2018 (e.g. 13:18):https://www.youtube.com/watch?v=2L2u303FAs8&list=PLht6tyws1YpSOGz2k6bUC1PibVG7ZiRFB&index=6&t=0s …
Show this thread
End of conversation
New conversation -
-
-
The NNs do very poorly on many of the regimes! The "strong" performance on the neutral split is arguably the least important/informative result, IMO.
Thanks. Twitter will use this to make your timeline better. UndoUndo
-
-
-
You seem to suggest that a NN by definition can't do (abstract) reasoning. But there's one in your head that seems to do it OK? We are interested in how to replicate that. Note also that NNs do v poorly on more than half of the generalisation splits in our dataset.
-
The brain is a neural network?
- Show replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.