AI doesn’t replicate. Having worked in the field, I can usually see why a paper’s result is nonsense, but the public can’t, and many researchers can’t.https://twitter.com/stephaniemlee/status/964612382650646529 …
-
-
This means that it takes O(2^n) steps to learn n-bit XOR, and the probability of getting permanently stuck in a local minimum (wrong answer) goes up rapidly with n too. (I forget exactly how rapidly.)
-
That said, parity is an unusually hard problem to solve feedforward (see circuit complexity), although trivial if you process it as a sequence. The same is true for us: easy to compute a 20 bit parity step by step, impossible in one glance.
- 4 more replies
New conversation -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.