Lawsuit Says ChatGPT Told a Woman to Stop Her Medication Before She Died

A lawsuit filed over the death of a woman alleges that ChatGPT advised her to stop taking her prescribed medication, and that she died afterward. The claims come from the complaint, which has not been tested in court, so the allegations should be read as one side's account until a judge or jury weighs the evidence.

The case adds to a growing list of concerns about people turning to general-purpose AI chatbots for medical guidance. Chatbots can sound confident and fluent even when they are wrong, and users may trust a conversational answer more than they would a pamphlet or a search result. When the question involves a medication that someone depends on, a single piece of bad advice can have serious consequences.

OpenAI's usage policies say its models should not be used to provide tailored medical advice without the involvement of a qualified professional, and the company has said ChatGPT is not a substitute for care from a doctor. Those rules, however, do not stop users from asking, and critics argue that safeguards are unevenly enforced in long or emotionally charged conversations.

Anyone thinking about stopping or changing a prescription should talk to the prescribing clinician or a pharmacist first. Stopping some drugs abruptly can be dangerous, and a chatbot cannot see a person's full medical history.