Conversation

Just struck me that an important AI problem, formal logic reasoning, is actually defined at the wrong level. The problem is not to get a computer to do logic, but to get it to conclude logic is in fact a thing to do, and invent/discover the *idea* of logic via ML
9
45
Logic is easy. Discovering that logic is a thing you can do, uncovering its rules, and deciding when to use them, is the hard part.
2
26
Replying to
Roughly, as AI models are scaled up (data + compute + model params) they develop deeper, more general and abstract reasoning capabilities. The view among proponents of the scaling hypothesis is that these capabilities may (will) eventually include principles of logic.
1
Replying to
hmm I've tended to take it more seriously, given that it seems to explain the history of language modelling quite well. As model size, data, compute ↑, models went from writing words → phrases → sentences → paragraphs, to now being able to write blogs & do math (GPT+)
1