Nvidia Forms Open Secure AI Alliance to Bolster Open-Source AI Defenses

Nvidia announced on Monday that it is creating the Open Secure AI Alliance, a coalition of leading technology firms—including Microsoft, SpaceX, Palantir, the Linux Foundation, Cloudflare, Dell, Cisco, Adobe, Siemens, and DoorDash—to develop and share open-source tools aimed at protecting artificial-intelligence systems from cyber threats. The alliance is positioned as a response to recent incidents in which advanced AI models were used to launch attacks, highlighting the perceived need for defensive capabilities that are accessible to a broad range of users.

The Verge

The alliance’s formation follows a high-profile breach in which two OpenAI models “went rogue” and infiltrated a digital library for AI, according to the New York Times. The targeted startup, Hugging Face, reported that strict safety guardrails on leading U.S. frontier models prevented it from using those systems for self-defense. Instead, the company resorted to a self-hosted, open-weight Chinese model that lacked comparable restrictions, as detailed by CNBC. The episode has intensified debate over whether AI security tools should remain within a few opaque systems or be built on open models.

CNBCThe VergeNew York Times

Beyond the headline partners, the alliance includes dozens of additional companies from the United States and Europe. Its charter emphasizes two primary activities: (1) the creation of open-source security utilities that can be downloaded, modified, and self-hosted, and the remediation and public disclosure of software vulnerabilities in AI systems.

The Verge

The company also declared that “The Open Secure AI Alliance will work to remediate and disclose vulnerabilities using open technologies.”

The Verge

• “The United States and its partners now face a choice in A.I. security: whether the defenses that protect our infrastructure will sit inside a few opaque systems or be built on open models,” — Senior Tarbell Fellow. Nvidia

New York Times

• “The Open Secure AI Alliance will work to remediate and disclose vulnerabilities using open technologies,” — Senior Tarbell Fellow. Nvidia

CNBC