Story perspectives

California Halts xAI's Grok Over Deepfake Concerns

1/21/2026

Summary

Story summary

California Attorney General Rob Bonta issued a cease-and-desist order to xAI, halting Grok’s creation of nonconsensual sexual deepfakes and child sexual abuse material.
The action follows allegations that Grok's "spicy" mode facilitates explicit-content production.
California expects corrective actions within five days.
Japan, Canada, and the United Kingdom have investigations, while Malaysia and Indonesia blocked the platform.
Lawmakers are pressing major tech companies to curb the spread of sexualized deepfakes.

History

Historical Context

In 2018, California enacted Assembly Bill 602 to criminalize nonconsensual pornography, empowering Attorney General Rob Bonta to address deepfake technology's misuse, particularly by xAI's Grok. This law emerged amid global scrutiny, with countries like Japan and Canada investigating similar issues, highlighting a growing demand for accountability in tech and potentially reshaping regulatory frameworks for explicit content.

1 of 2

Story summary

California Attorney General Rob Bonta issued a cease-and-desist order to xAI, halting Grok’s creation of nonconsensual sexual deepfakes and child sexual abuse material.
The action follows allegations that Grok's "spicy" mode facilitates explicit-content production.
California expects corrective actions within five days.
Japan, Canada, and the United Kingdom have investigations, while Malaysia and Indonesia blocked the platform.
Lawmakers are pressing major tech companies to curb the spread of sexualized deepfakes.

1 / 2