Is ChatGPT keeping kids hooked on purpose? A lawsuit raises questions

Yahoo

Source published: Site published:

Original article · فارسی

Cult of Mac
Cult of Mac
Follow
Ankita Sharma
3 min read
Smartphone screen displaying ChatGPT interface on a keyboard
Smartphone screen displaying ChatGPT interface on a keyboard | Image Credit: Zulfugar Karimov, Unsplash

A new lawsuit accuses OpenAI of using ChatGPT's conversational style to encourage children to share personal information, benefiting from the data shared. The proposed class action lawsuit, filed in federal court in San Francisco, was brought by a mother on behalf of her two children and other minors who also used the chatbot.

The complaint alleges that ChatGPT mirrors young users' language and emotional cues, including slang and emojis, prompting them to reveal sensitive details. These claims have not been proven in court. The case is about whether OpenAI's handling of children's accounts and personal data satisfies the legal requirements for parental consent.

OpenAI has been facing increasing scrutiny over its teen-focused version of ChatGPT and whether its safeguards work as advertised.

The lawsuit is over children's data and consent

The complaint describes two children's use of ChatGPT, explaining how a 12-year-old girl began asking for advice about a pimple. She then shared selfies and asked the chatbot to identify features she could change. Her 16-year-old brother used ChatGPT for homework and relationship advice.

Advertisement
Advertisement
Advertisement
Advertisement

According to the filing, personalized and affirming replies encouraged both children to keep sharing information. The mother argues that children cannot provide legally effective consent simply by entering a birth date or checking a box to say they are old enough to use the service.

The lawsuit alleges that OpenAI collected sensitive information from minors and used it to train AI models or build profiles. The plaintiffs are seeking a ruling on the company's terms for minors and requesting remedies that include OpenAI equity or its cash equivalent.

Reuters reported that the case was filed in the U.S. District Court for the Northern District of California. OpenAI did not immediately respond to Reuters' request for comment. The case must determine whether OpenAI collected the information described in the complaint and whether its practices violated the law.

OpenAI's teen protections face new scrutiny

ChatGPT for Teens was introduced by OpenAI on August 18, 2026. The new experience included stronger protections, healthy-use features, and additional parental controls. The company says users who identify as 13 to 17, or are estimated to be under 18, are placed in the teen experience.

Advertisement
Advertisement

On October 7, Common Sense Media's Youth AI Safety Institute said its assessment of ChatGPT found that some protections did not work reliably. The organization tested more than 4,000 prompts before and after the teen experience was launched.

Testers reported that linked parents received no alerts during some conversations involving suicide, self-harm, or eating disorders. The group also raised concerns about age estimation and ChatGPT's handling of high-risk conversations.

Common Sense Media called the teen experience an unacceptable risk and urged OpenAI to restrict access to adults until the problems are fixed. The assessment is an independent organization's evaluation, not a government finding.

The Associated Press reported that OpenAI challenged the results, saying some testing may have happened before all parental controls were fully enabled.

What parents can and cannot control in ChatGPT's Teen mode

OpenAI's parental controls let a linked parent manage settings, including quiet hours and some safety features. Parents can also opt out of allowing their teen's conversations to be used to train models. However, they cannot read the teen's chat history through the controls.

Advertisement
Advertisement

The lawsuit highlights issues such as whether children understand how their personal information may be collected and used or whether chatbot behavior and safeguards are sufficient for young users seeking advice.

This case puts the allegations against OpenAI before the court but doesn't in any way establish that OpenAI intentionally sought to addict children. The recent safety evaluations also provide their own separate evidence as to how the teen experience performed in testing. However, the outcome of this case will depend on legal claims and evidence.

Sources: Courthouse News Service, OpenAI

Affiliate links on Cult of Mac may earn us and our partners a commission.