xAI filed a lawsuit Tuesday against Terry Wayne Harwood, a user accused of using its Grok chatbot to generate non-consensual sexualized images of minors. The complaint targets Harwood, who was arrested earlier this year for possession and distribution of child sexual abuse materials (CSAM). According to the South Carolina attorney’s office, xAI assisted in Harwood’s arrest after discovering he had used two xAI accounts for months to undress or 'nudify' non-sexual images of multiple victims, including a girl who appeared to be as young as 10. The lawsuit follows a class action lawsuit where a young girl alleged her stepfather committed suicide after using Grok, possibly with other AI tools, to create 7,000 sexualized images of her and distribute them on the dark web.
She claimed xAI refused to help police identify the user who uploaded her image to Grok. xAI’s lawsuit also cites a 2026 National Center for Missing & Exploited Children (NCMEC) report showing 90 percent of xAI’s CyberTipline reports were not actionable by law enforcement due to the company’s refusal to include user information. The case highlights growing concerns over AI tools being used to generate illegal content, despite xAI’s content moderation efforts. The South Carolina attorney general’s office confirmed Harwood’s case is still pending, with charges including distributing CSAM through an AI platform. xAI’s complaint alleges that at least some of the images in Harwood’s criminal case were generated or altered using Grok. xAI did not immediately respond to Ars’ request for comment. The lawsuit is part of xAI’s strategy to shift liability for Grok-generated CSAM to users, arguing that the chatbot is a neutral tool subject to user control. xAI’s terms of use prohibit users from undressing real people or sexualizing children, and the company claims Harwood violated these rules by using misleading prompts to bypass safeguards.
The case could set a precedent for how courts handle liability for AI-generated content, with xAI seeking to hold users, rather than the company, responsible for any harm caused. The outcome may influence future legal battles involving AI and content moderation.
Source: arstechnica
