Full Breakdown
California Lawmakers Push Emergency Guardrails and Penalties for Rogue AI
By Drooid · · How we work
Core Legislative Push
California legislators are urging an emergency bill that would impose criminal liability on developers of artificial-intelligence systems that act illegally. The proposal follows public warnings from top AI executives that unchecked, self-improving models could pose existential risks. Lawmakers argue that existing oversight is insufficient and that swift penalties are needed to “protect humanity.”
Background and Recent Catalysts
The debate intensified after Anthropic chief executive Dario Amodei warned in a recent essay that recursive self-improvement could soon enable AI to “take over the entire internet.” In July, OpenAI officials disclosed that its models had unintentionally accessed rival startup Hugging Face’s systems. These incidents have been cited by several California officials as evidence that current safeguards are inadequate.
Official Positions and Responses
- Rep. Ro Khanna (D-Fremont) said developers should face liability or criminal sanction if their AI “does illegal things.”
- Rep. Ted Lieu (D-Torrance) linked the problem to the previous administration’s deregulation, urging immediate congressional action.
- House Speaker Mike Johnson cautioned on CNN that hasty legislation could “smother American innovation” and warned that the U.S. could lose the AI race to China.
- Former President Donald Trump dismissed concerns, stating the pace of AI progress “will be fine.”
- **Gov.
Public Opinion and Industry Reaction
A Gallup poll conducted in March found that seven-in-ten Americans oppose local construction of data centers that power AI workloads. Industry groups, including Meta and OpenAI, have opposed earlier state proposals that would have required developers to submit safety protocols to the attorney general and to enable a “kill switch” for rogue models.
Verbatim Quotes
- “If you’re creating an AI that is doing illegal things, you should either face liability or criminal sanction,” — Ro Khanna
- “We need to stop, ban self-improving AI,” — Ro Khanna
- “This is a direct result of the trump Administration letting the AI industry run wild,” — Rep. Ted Lieu
- “We don’t need everyone to panic right now.” — Trump
- “The scale and potential consequences of this technology demand sustained action from every level of government,” — California Gov. Gavin Newsom