Opens profile photo
Follow
Click to Follow AndrewLBeam
Andrew Beam
@AndrewLBeam
Machine learning for medicine. Assistant Professor: , , || Co-host NEJM AI Grand Rounds (), Co-founder
Boston, MAbeamlab.orgJoined March 2013

Andrew Beam’s Tweets

#GPT3 for diagnosis and triage. How good is it? (note: awaiting peer-review) bit.ly/3kQoNJW
Quote Tweet
New preprint! Q: How accurate is GPT-3 at predicting Dx and triage advice compared to Harvard docs and to an average person Googling their symptoms? For Dx, GPT-3 is much more accurate than your average person and almost as accurate as the Harvard docs! For triage, not so much.
Show this thread
Image
Image
4
I found these results pretty interesting! The Dx performance was good, but it's worth thinking about what's up with triage, since that is arguably the best use case for something like GPT-3. If you are interested, read the full paper for more details:
1
12
Show this thread
We used a small set of well-validated, synthetic patient vignettes confirmed to not be part of GPT-3's training data. We compared GPT-3's performance to a sample of attending internal medicine docs and to a random sample of 5,000 people who were allowed to use the internet.
1
6
Show this thread
New preprint! Q: How accurate is GPT-3 at predicting Dx and triage advice compared to Harvard docs and to an average person Googling their symptoms? For Dx, GPT-3 is much more accurate than your average person and almost as accurate as the Harvard docs! For triage, not so much.
Image
Image
7
89
Show this thread
Looks like there is now a path to use the OpenAI tech stack (GPT-3, ChatGPT, etc) on data with PHI:
Quote Tweet
‼️Healthcare AI builders‼️ @Microsoft Azure @OpenAI Service is now HIPAA ready (+ includes support for zero-shot or specialized model creation via fine tuning on your own data)! azure.microsoft.com/en-us/products Check out this content for tips: lnkd.in/dUVZC6Ki
Image
18
Very excited to be speaking at this event, and I will see you in Fort Lauderdale!
Quote Tweet
Here are 7 more reasons to grab your ticket to Delphi! We've got 7 more speakers joining the conference, and more to be announced! 📆 March 27-29, 2023 📍Fort Lauderdale, Florida 🎟 buff.ly/3XJXXSC #MedEd #EBNeo #NICU #Neonatologia #Neonatology #Neonatology
Image
Image
Image
8
On the next episode of AI Grand Rounds, we sit down with the prodigious Pranav Rajpurkar () to talk about AI in radiology, what he learned about mentorship from , and the impact of large self-supervised models on medicine. Link:
18
ChatGPT is rising rapidly through the academic ranks - from middle author to corresponding in just a few days! sciencedirect.com/science/articl. h/t
Image
Quote Tweet
Check out the author list h/t ⁦@AndrewLBeam⁩ Performance of ChatGPT on USMLE: Potential for AI-Assisted Medical Education Using Large Language Models | medRxiv medrxiv.org/content/10.110
3
29
Excited to release with my co-host the first episode of Grand Rounds -- an enlightening and fun conversation with of
Quote Tweet
The first episode of NEJM AI Grand Rounds is live! Listen as our first guest, @StanfordMed Associate Dean @euanashley, shares how his team is using #ArtificialIntelligence to prevent, predict, and beat disease: ai-podcast.nejm.org/e/dr-euan-ashl
1
16