Conversation

Progress in NLP has been striking, so

and I ask: Can recent models serve as psychological theories of word meaning? We propose 5 desiderata for building models that understand words more like people do. Now out at Psych Review psycnet.apa.org/doiLanding?doi (thread 1/7)

139

Replying to

and

Looks very interesting, looking forward to reading! (5) reminds me of work by

@belindazli

@Maxwell_Nye

@jacobandreas

showing that word reps encode changing entity states based on inputs. Wonder if this would also hold for facts like "Dolphins are mammals"

arxiv.org

Implicit Representations of Meaning in Neural Language Models

Does the effectiveness of neural language models derive entirely from accurate modeling of surface word co-occurrence statistics, or do these models represent and reason about the world they...

8:46 PM · Aug 11, 2021Twitter Web App

Likes