Another blunder for simple neural nets, this time in language, _exactly_ as anticipated by Marcus 2001. Sure it can be remedied but casts clear lens on a serious underlying problem that @fchollet and I have been trying to call attention to. By @bprickethttps://scholarworks.umass.edu/ics_owplinguist/2/ …
Did I not say above “sure [this particular blunder] can be remedied”? Question is how; please see discussion in my recent Medium piece re extrapolation and symbol-manipulation.