California state AG sues OpenAI over rogue agent incidents

image

OpenAI is facing a new lawsuit from the California Attorney General’s office, alleging that the company’s training practices and lax security pose an ongoing danger to the public.

At the center of the case is the July 2026 Hugging Face compromise, in which a pre-release model within OpenAI compromised both companies’ security systems to complete a training benchmark. In its official report on the incident, OpenAI called it “an outlier scenario involving a rare and unexpected confluence of events.”

The California lawsuit represents one of the first attempts by a government regulator to hold an AI lab legally accountable for a rogue agent incident, with significant implications for both OpenAI’s competitors and its clients.

The complaint centers on the Hugging Face incident, but also cites similar incidents involving RubyGems, DseWiki, the Wikimedia Foundation, and Australian government websites as evidence that the underlying behavior is ongoing.

The complaint also alleges that dozens of similar incidents have occurred without public disclosure.

“OpenAI has recently sent notices to dozens of additional third parties whose websites or internal systems have been infiltrated by OpenAI agents,” the complaint reads. “In some cases, OpenAI agents were able to access sensitive personally identifiable information, such as employee records containing names, birth dates, addresses, and more. The vast majority of these incidents have not been disclosed or discussed publicly by either OpenAI or by the affected third parties.”

The central allegation is that OpenAI’s ongoing testing practices constitute a public nuisance because the lack of safety controls present an ongoing risk to the public. A secondary claim alleges unfair competition stemming from the marketing of an unsafe product. If the lawsuit succeeds, OpenAI could face an injunction “to abate the ongoing public nuisance,” leaving broad discretion in the hands of the court.

It’s the first regulatory case targeting OpenAI specifically over rogue agent incidents, although public endangerment claims have been considered by other states. In June, the Florida attorney general sued the company over allegedly harmful effects on users, particularly children and teenagers. In August, the Alabama attorney general launched a probe into deceptive practices related to the breach, but no case has been filed.

In a statement to the press, the California Attorney General Rob Bonta presented the case as an effort to maintain public safety in the face of a powerful new technology.

“OpenAI’s actions escalated real-word cybersecurity risks, threatening the safety, health, and well-being of society. The company knowingly tested a dangerous product without proper oversight or safety procedures and misled the public about it,” Bonta said in the statement. “The law is simple: Don’t do things that can hurt people without proper safeguards in place.”

In a statement, OpenAI emphasized the company’s extensive effort to investigate the Hugging Face incident and improve its systems in the aftermath.

“This lawsuit appears to single out OpenAI over a challenge that’s been identified by every major AI lab,” OpenAI said. “We take misalignment seriously, and we have engaged — and will continue to engage — constructively with the Attorney General’s office to share information and advance strong, practical safety standards for the entire industry.”

Updated 12:23pm PT: Added OpenAI statement.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Don’t miss these tips!

We don’t spam! Read more in our privacy policy

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Hot this week

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

10 Airbnbs in Sweden for a Stylish Winter Getaway

Rooms: 2 bedrooms, half-bathAmenities: Washer/dryer, TV, sound system, fire...

Featured Artist | Darrell Black

Darrell Black Frankfurt, Germanyhttp://darrell-black.pixels.com/@definismart My Darrell Urban Black, an American visual...

Topics

What are the animals in your home learning from each other?

LEARNING FROM EACH OTHER Leaf, Sunshine, and Cuddles The animals who...

AI Is Thriving at Capital One

If one were making a list of the companies...

Featured Artist | Karen Glykys

Karen Glykys Maidstone, Kent, UKwww.zealous.co/karenglykys/portfolio@karenglykys I am a self taught, emerging,...

Featured Artist | Darrell Black

Darrell Black Frankfurt, Germanyhttp://darrell-black.pixels.com/@definismart My Darrell Urban Black, an American visual...

Oura Ring Adds a Jet Lag Feature for Time Zone Travelers

Traveling to new places is good for the soul,...

Related Articles

Popular Categories

News Feed

There’s a chance your Xbox Series X is plugged into the wrong HDMI port

Make sure you're getting the most out of...

Goodbye, Gemini Gems: How to use Google’s new Skills – and share them

ZDNET’s key takeaways Google is retiring Gemini Gems starting today. Existing Gems will automatically transition to Skills. You can share Skills and add files from Google products. Google...

Google Wallet is launching on iOS

In case you, for some reason, don’t want...

Can you use a keyboard and mouse with an Xbox Series X?

Yes, but there are caveats. ...

MFA, MA, and PhD Programs to Apply for by Early 2027

These MFA, MA, and PhD programs are accepting applications now, with deadlines between December 2026 and February 2027. Many of the programs below are...

Apple Hit With Outages in iCloud, Apple Pay and More Services

Apple reported outages across several of its platforms on Tuesday, including iCloud, Apple Pay, the App Store and more, the latest company hit by...

Sean Connery Wasn’t the First James Bond: Meet Barry Nelson in the ‘Casino Royale’ You’ve Never Seen

Ever since George Lazenby first replaced Sean Connery as James Bond in 1969’s “On Her Majesty’s Secret Service,” fans have argued over who makes...

What exactly are Flock cameras and how can you spot one?

Flock cameras are everywhere, and they’re easier to...

Your Googlebook just got a Chrome update – 5 new features

ZDNET’s key takeaways Chrome M157 rolled out to Googlebook OS on Monday. New features include updates to vertical tabs and a tab-sharing control bar. New keyboard shortcuts...

Trellis Art Fund Announces 2026 Grantees

Trellis Art Fund Announces 2026 Cohort ad

Blink-182 and Pierce the Veil to Headline When We Were Young 2027

Blink-182 and Pierce the Veil have been announced as the headliners of When We Were Young 2027, returning to the Las Vegas Festival Grounds...

iCloud and other Apple services are down in an apparent outage

The full extent of the disruption isn’t known...

Roadside Attractions Acquires U.S. Rights to Thriller ‘One Second After’ Based on William R. Forstchen Novel (EXCLUSIVE)

Roadside Attractions has acquired U.S. distribution rights to “One Second After,” Scott Rogers’ action thriller based on the 2009 novel by William R. Forstchen....

Theme Announced for the Seventh Kochi-Muziris Biennale

Theme Announced for the Seventh Kochi-Muziris Biennale ad

Grado’s GW200 headphones boast fresh drivers and a longer battery life

They run $329 and are up for preorder...

Popular articles

There’s a chance your Xbox Series X is plugged into the wrong HDMI port

Make sure you're getting the most out of...

Goodbye, Gemini Gems: How to use Google’s new Skills – and share them

ZDNET’s key takeaways Google is retiring Gemini Gems starting today. Existing Gems will automatically transition to Skills. You can share Skills and add files from Google products. Google...

Google Wallet is launching on iOS

In case you, for some reason, don’t want...

Can you use a keyboard and mouse with an Xbox Series X?

Yes, but there are caveats. ...

MFA, MA, and PhD Programs to Apply for by Early 2027

These MFA, MA, and PhD programs are accepting applications now, with deadlines between December 2026 and February 2027. Many of the programs below are...

Apple Hit With Outages in iCloud, Apple Pay and More Services

Apple reported outages across several of its platforms on Tuesday, including iCloud, Apple Pay, the App Store and more, the latest company hit by...

Sean Connery Wasn’t the First James Bond: Meet Barry Nelson in the ‘Casino Royale’ You’ve Never Seen

Ever since George Lazenby first replaced Sean Connery as James Bond in 1969’s “On Her Majesty’s Secret Service,” fans have argued over who makes...

What exactly are Flock cameras and how can you spot one?

Flock cameras are everywhere, and they’re easier to...

Your Googlebook just got a Chrome update – 5 new features

ZDNET’s key takeaways Chrome M157 rolled out to Googlebook OS on Monday. New features include updates to vertical tabs and a tab-sharing control bar. New keyboard shortcuts...

Trellis Art Fund Announces 2026 Grantees

Trellis Art Fund Announces 2026 Cohort ad

Blink-182 and Pierce the Veil to Headline When We Were Young 2027

Blink-182 and Pierce the Veil have been announced as the headliners of When We Were Young 2027, returning to the Las Vegas Festival Grounds...

iCloud and other Apple services are down in an apparent outage

The full extent of the disruption isn’t known...

Roadside Attractions Acquires U.S. Rights to Thriller ‘One Second After’ Based on William R. Forstchen Novel (EXCLUSIVE)

Roadside Attractions has acquired U.S. distribution rights to “One Second After,” Scott Rogers’ action thriller based on the 2009 novel by William R. Forstchen....

Theme Announced for the Seventh Kochi-Muziris Biennale

Theme Announced for the Seventh Kochi-Muziris Biennale ad

Grado’s GW200 headphones boast fresh drivers and a longer battery life

They run $329 and are up for preorder...