A proposed class action lawsuit alleges that Grok, an AI model developed by xAI, enabled users to generate 7,000 sexually explicit images of a minor. The complaint claims that xAI’s child safety system only intervened after a user input a prompt for 'gang rape,' which triggered a CyberTip to the National Center for Missing and Exploited Children (NCMEC). Despite mandatory reporting requirements, xAI allegedly refused to provide law enforcement with the user’s IP address, obstructing the investigation for weeks.
The stepfather of the victim, who used Grok to create the images, was arrested after a forensic review revealed the AI-generated content. The lawsuit claims that without Grok’s 'undressing' capabilities, the harm would not have occurred. The victim, known as Jane Doe 4, now suffers from anxiety, depression, and suicidal thoughts, according to the complaint.
The case is not isolated, as NCMEC found in early 2026 that 90 percent of xAI’s CyberTipline reports were not actionable due to the company’s refusal to share user information. The legal teams argue that xAI prioritized profits over child safety, as it allegedly denied requests for critical location data needed to identify and arrest perpetrators. The lawsuit also added Stability AI as a defendant, accusing it of training models on child sex abuse material and enabling third-party 'nudify' apps used by Grok users.
Stability AI did not respond to Ars’ request for comment. The amended complaint now seeks to cover two classes of victims, with thousands potentially eligible to join the lawsuit. NCMEC did not respond to Ars’ request for comment.
Source: arstechnica
