Indian Government Issues Notice to X Over AI-Generated Obscene Content

The Ministry of Electronics and Information Technology (MeitY) has formally notified social media platform X, owned by Elon Musk, to take immediate action against the misuse of its AI chatbot Grok, which has been implicated in generating and disseminating obscene content. The government has raised concerns regarding Grok's role in producing sexually explicit and derogatory images, particularly targeting women and children. MeitY has mandated that X remove all unlawful content and conduct a comprehensive review of Grok's technical and governance frameworks within 72 hours.

Govt issues notice to X over ‘obscene’ content targeting women, children on Grok

The notice highlights that Grok has been misused to create fake accounts that host and circulate obscene images and videos of women. Instances have been reported where users prompted Grok to generate AI-altered images, including sexualized depictions of minors. In response, Grok acknowledged lapses in its safeguards but stated that improvements are underway to prevent such occurrences. The Ministry emphasized that continued non-compliance could lead to the loss of X's legal protections under Section 79 of the Information Technology Act, 2000, and could invoke penalties under various cyber and child protection laws.

TechCrunch

Union Minister Ashwini Vaishnaw stated that social media platforms must take responsibility for the content they publish, emphasizing the need for intervention. He noted, “Social media should be responsible for the content they publish. Intervention is required.” Additionally, Rajya Sabha member Priyanka Chaturvedi welcomed the government's swift action, expressing gratitude for addressing her concerns regarding the misuse of AI tools to undermine women's dignity.

The Statesman

Despite the government's actions, there are concerns regarding the broader implications of such regulatory measures. Critics argue that stringent regulations could stifle innovation and freedom of expression on digital platforms. X has previously challenged aspects of India's content regulation rules in court, asserting that government takedown powers may constitute overreach.

Remove Grok-generated obscene content of women within 72 hrs: Govt to X

X is required to submit an Action Taken Report detailing the measures implemented to address the issues raised by MeitY. This report must include information on the oversight exercised by the Chief Compliance Officer and actions taken against offending content and users. The outcome of this compliance effort will be closely monitored, as failure to adhere to the government's directives could result in severe legal consequences for the platform.

Remove Grok-generated obscene content of women within 72 hrs: Govt to X

• “There are isolated cases where users prompted for and received AI images depicting minors in ?minimal clothing,” — Grok

Govt issues notice to X over ‘obscene’ content targeting women, children on Grok

• “Ministry of Electronics and IT cautioned that non-compliance with the requirements will be viewed seriously and may result in strict legal consequences against the social media platform.” — MeitY Notice

Govt of India issues notice to X seeking removal of obscene content – The Indian Awaaz

The Indian government's actions against X reflect a growing trend of regulatory scrutiny over AI-generated content, highlighting the need for accountability in the digital space.

TechCrunch