#Medical #AI has the worst superpower... Racism
We've put out a preprint reporting concerning findings. AI can do something humans can't: recognise the self-reported race of patients on x-rays. This gives AI a path to produce health disparities.
1/8
https://lukeoakdenrayner.wordpress.com/2021/08/02/ai-has-the-worst-superpower-medical-racism/ …pic.twitter.com/YTYh5TlBnD
-
Show this thread
-
This is a big deal, so we wanted to do it right. We did dozens of experiments, replication at multiple labs, on numerous datasets and tasks. We are releasing all the code, as well as new labels to identify racial identity for multiple public datasets. 2/8
6 replies 6 retweets 106 likesShow this thread -
Humans can't detect race better than chance, but AI performs absurdly well on the task. As you can see here, AUC scores are in the high 90s, and are maintained on external validation on completely distinct datasets and across multiple different imaging tasks. 3/8pic.twitter.com/YJMEp6NjQt
21 replies 23 retweets 140 likesShow this thread -
We performed many experiments to work out how it does this, but couldn't pin it down. This is the most ridiculous figure I have ever seen. AI can detect race from images filtered so heavily they are just blank grey squares! (see the bottom right of the figure) 4/8pic.twitter.com/cDC7k44wcO
41 replies 69 retweets 326 likesShow this thread -
Loading seems to be taking a while.
Twitter may be over capacity or experiencing a momentary hiccup. Try again or visit Twitter Status for more information.