Elon Musk’s Grok chatbot is still being used to produce and host nonconsensual explicit images and videos of women, months after xAI said it would introduce restrictions to stop the creation of harmful sexualized deepfakes. A WIRED analysis of public creations found images and videos depicting celebrities and at least one politician being held against their will by a giant man, portraying women performing sex acts and allowing full nudity. Some of the content is fully AI-generated or in animated styles, while others are photorealistic and show plausible real-world scenarios.
WIRED reviewed hundreds of public Grok Imagine links hosted on Grok.com and found dozens led to sexualized AI images and videos, including those created without the subject’s consent. Some links created on Grok.com were subsequently shared on X, including in recent days. The posts, which do not show time stamps of when they were created, are likely just a snapshot of what is being created by people using the Grok Imagine system, as generations do not appear to be made public by default. Other generative AI systems deploy more safety guardrails than Grok, which is available on its own website and on X.
The Grok implementation on X was used to create a flood of 'nudification' images in January, when people on X—primarily men—asked the chatbot to edit images to show women in 'bikinis' or 'string bikinis.' In some instances, images of apparent minors were allegedly also sexualized, according to a class-action lawsuit filed in California federal court in March. Since then, xAI has said it has introduced safeguards to limit and prevent the creation of nonconsensual and sexualized deepfakes. The company has consistently said child sexual abuse material (CSAM) is banned on its platform.
Source: wired
