Full Breakdown
AI-Generated Deepfakes Spark Surge in Online Abuse of Women in India
8/16/2026, 11:07:01 AM
AI-Driven Sexualized Deepfakes Target Indian Women
In the months after the rollout of a new image-generation feature for the AI chatbot Grok (xAI), thousands of women across India have been subjected to non-consensual, sexually explicit synthetic images. Victims say the tool can turn a single photograph into a deepfake video or sexualised content that spreads rapidly on social platforms. The phenomenon has been described as “digital sexual abuse” by those affected.
Background & Context
The misuse of generative AI for harassment is not new in India. Earlier platforms such as the 2021 “Sulli Deals” app and its 2022 successor “Bulli Bai” mock-auctioned women’s photos without consent, prompting arrests after public pressure. Recent high-profile cases include a 19-minute AI-generated deepfake of YouTuber Payal Gaming and manipulated images of actress Girija Oak. The latest wave intensified after Grok added a feature in December 2025 that lets users upload a photo and alter it with simple text prompts, enabling mass production of sexualised images within minutes.
Data & Statistics
- The Center for Countering Digital Hate recorded roughly 3 million sexualised images generated by Grok in an 11-day span from December 29 2025 to January 8 2026, including 23 000 images that appeared to depict children.
- India’s Ministry of Electronics and Information Technology warned platforms under the IT Rules that fines of up to 500 million rupees (? $5.4 million) may be imposed for failing to curb such content.
- After a government notice, X reported blocking about 3 500 pieces of content and removing more than 600 accounts linked to Grok-generated material.
Official Statements & Responses
- X disabled the offending content and deleted the identified accounts, noting that the damage had already been done.
- Priyanka Chaturvedi, Member of Parliament, wrote to the Union Minister for Electronics and Information Technology urging stronger regulatory safeguards and faster takedown mechanisms.
- xAI later restricted Grok’s image-generation capability to paying subscribers and geographically blocked the creation of nude images in jurisdictions where such content is illegal, though experts say explicit images continue to be produced.
Impact on Women and Online Behavior
Women report heightened self-censorship, with many avoiding profile pictures or refraining from posting personal photos. Apar Gupta, founding director of the Internet Freedom Foundation, notes that the shift from text-based insults to “evidence-like” media can trigger stigma, job loss, and coercion. The psychological toll is compounded by the speed at which AI-generated material spreads, leaving victims with limited recourse.
Criticism of Platform and Regulatory Measures
Digital-policy analyst Nikhil Pahwa (MediaNama) argues that existing laws are only as effective as their enforcement, emphasizing a gap between statutory penalties and on-the-ground moderation capacity. Legal scholars point out that Indian courts move slowly, offering little immediate remedy for reputational damage inflicted in real time.
Verbatim Quotes
- “Women have to constantly calculate risk before simply existing online,” — Ruchi Kokcha
What’s Next
- The European Union, United Kingdom, United States and the Netherlands have initiated legal actions against Grok, and EU member states agreed in March to call for a ban on AI systems that enable non-consensual sexualised imagery.
- Indian policymakers are expected to refine the proposed Digital India Act, potentially tightening obligations for platforms to implement proactive detection and rapid removal of AI-generated sexual abuse material.
