For years, clinicians have received an earful about the way that AI will transform the diagnosis process. To hear its disciples tell it, AI will remove physician bias and speculation from the equation, resulting in faster, more accurate diagnoses.

As it turns out, AI might have some issues of its own. A study published in JAMA Network Open compared AI chatbot responses to clinical scenarios previously tested in doctors. The goal was to see whether the recommendations would change when variations in race, gender and ethnicity were introduced. They did — but not in the ways one might expect. In other words: Leave your assumptions at the door.

Click image to enlarge.

Click image to enlarge.

For an April 2024 article on AI social media analysis failing to detect depression among Black patients, click here.