looking for pretrained language models that i can readily test a draft world-state change benchmark on.
GPT is scoring essentially zero.
what’s out there that is better that I can try?
@ylecun @AntoineBordes @jaseweston still would like to test your recurrent entity networks
-
To be fair, none of the statistical language models are trained on tracking or understanding tasks. They are trained to be statistical language models. Is someone claiming otherwise?
1. yes Hinton has dismissed my claim "talent of feature detectors.. doesn't translate into understanding novel sentences, in which each sentence has its own unique meaning" on basis of "success" of statistical systems (eg Google Translate)
