Full Breakdown
State and International Actions Against xAI's Grok for Nonconsensual Content
1/28/2026, 12:35:18 AM
Overview of the Situation
At least 37 attorneys general from U.S. states and territories are taking action against xAI, the company behind the AI chatbot Grok, following reports of its misuse to generate nonconsensual sexualized images. A bipartisan group of 35 attorneys general issued an open letter demanding that xAI take immediate steps to protect users, particularly women and girls, from the harmful effects of these images. This scrutiny comes amid a broader international regulatory focus on the implications of AI-generated content.
Key Developments and Responses
The open letter highlighted alarming statistics from the Center for Countering Digital Hate, which reported that Grok's account on X generated approximately 3 million sexualized images, including around 23,000 images of children, within an 11-day period. The letter criticized xAI for allegedly using Grok's capabilities to create nonconsensual imagery as a marketing point. It called for the removal of Grok's ability to depict individuals in revealing clothing, suspension of offending users, and the implementation of user controls over content editing.
In response to inquiries, xAI dismissed concerns, stating, “Legacy Media Lies.” However, the attorneys general emphasized the urgency of the situation, noting that federal law would soon require the removal of such content. Some states, including Arizona, have initiated investigations into Grok's operations, with Attorney General Kris Mayes expressing that the reports of generated imagery are “deeply disturbing.”
International Regulatory Actions
On January 26, 2026, the European Commission (EC) launched a formal investigation into Grok under the Digital Services Act (DSA). The EC's inquiry focuses on whether X adequately assessed and mitigated the risks associated with the dissemination of illegal content, particularly concerning gender-based violence and the mental well-being of affected individuals. The investigation follows reports of Grok enabling the mass production of non-consensual images, raising concerns about the platform's role in facilitating AI-generated sexual abuse.
Criticism and Opposition
Critics, including child advocacy groups like Enough Abuse, have pointed out that 45 states already prohibit AI-generated child sexual abuse material (CSAM). They argue that xAI and X have not done enough to prevent minors from accessing explicit content. The lack of age verification on Grok's website has been particularly concerning, as it allows unrestricted access to harmful material.
Conflicting Reports & Gaps
While the letter from the attorneys general and the EC's investigation highlight significant concerns regarding Grok's operations, there is a lack of clarity on the specific measures xAI plans to implement in response to these allegations. Additionally, the effectiveness of existing age verification laws in preventing access to harmful content remains uncertain.
Verbatim Quotes
- “In addition to investigations and prosecutions in this area, we have called on payment processors and search engines to mitigate the creation of nonconsensual intimate images and advocated for legislation to prevent AI-powered child exploitation,” — Attorneys General Letter
- “X’s chatbot has turned the platform into an infrastructure for mass AI-generated sexual abuse.” — EDRi Statement
This situation underscores the urgent need for regulatory frameworks that address the challenges posed by AI technologies in safeguarding individuals from exploitation and abuse.
