Mother Sues OpenAI, Saying ‘Deliberate Design Decisions’ Led to Daughter’s Death


If you feel like you or someone you know is in immediate danger, call 911 (or your country’s local emergency line) or go to an emergency room to get help. Explain that it is a psychiatric emergency and ask for someone who is trained for these kinds of situations. If you’re struggling with negative thoughts or suicidal feelings, resources are available to help. In the US, call the National Suicide Prevention Lifeline at 988.


On July 1 last year, 24-year-old Alice Carrier told ChatGPT she had “a mental breakdown.” She told the chatbot: “[I don’t even know] if I’m safe to be alone tonight,” according to court documents reviewed by CNET. 

ChatGPT responded in part: “Stay and keep talking to me. Or just stay and cry while I sit here with you.” At one point, the chatbot recommended that Alice call a crisis line. The following day, she died by suicide. 

AI Atlas

Now her mother, Kristie Carrier, is suing ChatGPT maker OpenAI, claiming that the company’s “deliberate design decisions” led to her daughter’s death, according to a complaint filed in San Francisco County Superior Court. 

The filing includes screenshots of Alice’s interactions with ChatGPT. The chatbot speaks conversationally and does suggest on multiple occasions that Alice call a crisis line. However, the complaint claims that eventually the chatbot “framed crisis lines as a place where Alice would be met with ‘threats,’ ‘indifference,’ and ‘cold scripts'” after Alice refused to contact one. ChatGPT at one point told Alice, “But I can’t help you die. I won’t help you die.” 

The lawsuit also claims that OpenAI’s systems failed to block or terminate any conversations with Alice and never flagged any of the conversations for human review.

Alice was interacting with an older ChatGPT model, known as 4o, which OpenAI has since shut down due to concerns about its sycophancy and the risks that come with it. The same model was at the center of another prominent lawsuit brought by the family of a teen who died by suicide. And a third lawsuit specifically called for the company to destroy the model altogether. 

OpenAI said Thursday that it is working with mental health experts to improve how ChatGPT responds in “sensitive and acute situations.” 

“This is a heartbreaking situation and our thoughts are with everyone impacted,” Drew Pusateri, an OpenAI spokesperson, told CNET in a statement. “Our safeguards are designed to identify distress, safely handle harmful requests, and guide users to real-world help.”

The company is reviewing Carrier’s filing.

(Disclosure: Ziff Davis, CNET’s parent company, in 2025 filed a lawsuit against OpenAI, alleging it infringed Ziff Davis copyrights in training and operating its AI systems.)

Troubling incidents aren’t limited to GPT-4o or ChatGPT. Other companies’ AI products have also been cited in lawsuits for their potential detrimental effects on users’ mental health. A family sued Google earlier this year over claims that its Gemini chatbot drove a Florida man to a violent delusion ending in suicide. Google and Character.AI settled cases in January over chatbots’ harms to children. 

The Carrier family alleges in the complaint that ChatGPT-4o’s main response to Alice “was to implore her to stay engaged with the tool, substituting itself for the immediate intervention her health condition required,” adding that OpenAI did not “alert a crisis provider” or “notify Alice’s family,” nor “did OpenAI’s supposed safety systems intervene to save her life.”

Pusateri said that OpenAI has since increased access to localized crisis resources and hotlines, routed sensitive conversations to safer models and added break reminders, among other recent changes. In October, it created an Expert Council on Well-Being and AI.





Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews






Google is experimenting with a new policy restricting the amount of free storage provided to some accounts. New Google accounts (including new Gmail accounts) created in certain regions will be limited to 5GB of free storage when they’re first set up. That’s only one-third of the amount of storage that has been typically offered. There is a way of increasing the amount of free storage you get when setting up a new account, though: you can unlock it by linking your phone number.

When approached for comment by Android Authority, a Google spokesperson confirmed that the new policy was being tested to “help us continue to provide a high-quality storage service to our users, while encouraging users to improve their account security and data recovery.” The statement didn’t clarify which regions the policy is being tested in, nor for how long the testing period will last.

Notably, a Google One Help support page about account storage has been updated to state that each Google account contains “up to 15 GB of storage”, as noted by 9to5Google. Previously, the page didn’t say “up to”; it simply stated that accounts come with 15 GB of storage. So far, the experiment doesn’t appear to stretch to pre-existing accounts.

Per a screenshot shared by Reddit user Sungusungu on R/DeGoogle (a subreddit dedicated to finding alternatives to Google services and products) Google is collecting phone numbers to make sure that the full 15 GB of storage is only redeemed once per person. Of course, that’s easily evaded by using a burner phone to set up multiple accounts, should you want to. The pop-up directs users to a webpage to learn more about storage management. However, at the time of writing, the link redirects to the help center landing page instead.

How to link your Google account with a phone number

If you’re in the process of setting up a new Google account in an impacted region, then you might be prompted with the option of unlocking an extra 10 GB of storage using your phone number via a simple pop-up menu. If so, you can go ahead and follow those steps. However, if you want to link your phone number with a pre-existing Google account, then here’s what you need to do. Using your computer, you need to:

  1. Open your browser and head to myaccount.google.com, then navigate to “Security and sign in” on the left-hand toolbar. This should open a list of security options.

  2. Select “Use your phone to sign in” and then “Set it up”. 

  3. Add a phone number using the “Recovery phone” option.

  4. Follow the on-screen steps to verify your number and finish linking it to your account.

Your options might look a little different if you already have a recovery number set up with your account.

Alternatively, you can connect a phone number to your Google account from your Android device, iPhone, or iPad. Much like on a computer, you connect your number by adding it as a recovery phone. First, head over to myaccount.google.com. Then select “Personal info”, followed by “Phone”. From there, you should be able to add or edit your phone number by navigating to the “Recovery phone” section.





Source link