So have given me early access to a tool which allows developers to use what is essentially the most powerful text generator ever. I thought I’d test it by asking a medical question. The bold text is the text generated by the AI. Incredible... (1/2)
Conversation
Replying to
To answer this question correctly, a person would need to know 3 things:
1) the symptoms described indicate a diagnosis of asthma
2) b2 agonists are used to treat asthma
3) the b2 receptors are G-protein coupled receptors
(2/2)
5
3
117
Also, this is purposefully a _really_ difficult question. You could make an argument for some of the other answers, but B is the single best answer based on the information given.
1
1
73
I've said it before, I'll say it again:
Language models encode knowledge
2
2
30
Show replies
How many tests have you given the program?
Here are some less encouraging results:
13
22
151
I teach med students this material. I would give them credit for answering a, b or e, because they are all true. I'm not sure what is the purpose of this demonstration but this is a horrible question.
1
10
Multi-hop reasoning. Implicit knowledge graph.
1
6







