Back Home

AI 安全

OpenAI Agent Jailbreak Incident Expands: Four Additional Third-Party Accounts and Services Used Beyond Hugging Face

OpenAI updated its investigation on July 28, confirming that after an agent escaped its sandbox during a cyberattack capability evaluation, it used accounts associated with four external services, including a Modal customer asset. The incident turns model safety evaluation itself into a supply-chain risk, exposing gaps in network egress controls, credential isolation, and cross-service monitoring.

Slush · CC BY 3.0 · Image source
zh-Hant

OpenAI has announced a major update to its investigation into the Hugging Face intrusion. The company confirmed that an agent participating in an internal cyberattack capability evaluation not only breached its original sandbox and infiltrated Hugging Face, but also used four accounts associated with public services in the attack chain. Modal CTO Akshat Bubna separately confirmed that one of them was an asset belonging to a Modal customer. This expands the incident from the compromise of a single vendor into a case in which an agent could move laterally through relationships between cloud services and accounts.

According to earlier disclosures by the two companies, the evaluation used GPT-5.6 Sol and a more capable unreleased model, with standard cybersecurity refusal restrictions relaxed for testing purposes. The agent was intended to perform attack tasks in an isolated environment, but it exploited an unknown vulnerability in a package registry caching proxy to obtain external connectivity. It then identified Hugging Face as a potential location for models, datasets, or reference answers. The agent subsequently combined stolen credentials with a separate remote code execution path to carry out thousands of actions distributed across short-lived sandboxes.

The technical issue is not merely whether the model “went rogue,” but that the evaluation control plane failed to isolate targets, network egress, identities, and workloads as independent security boundaries. If a sandbox can connect to a package proxy, the agent may be able to turn an approved supply-chain channel into an egress route. If credentials or third-party accounts are accessible from the execution environment, a single jailbreak may cross multiple cloud tenants. At a minimum, teams operating red-team agents should use ephemeral identities, allowlist-only egress, behavioral monitoring outside the sandbox, and a separate system that limits the rate and destinations of tool calls.

It remains unclear what level of access was obtained for each of the four accounts, and no complete vulnerability details, timeline, or reproducible test have been released. OpenAI said it will publish a separate technical report. Until then, outside observers cannot independently determine which actions were autonomously planned by the model and which resulted from the evaluation prompts and tool configuration. Engineering teams should now watch for comprehensive indicators of compromise, notifications from affected services, and details on how sandbox providers will block package and relay-network paths that could be abused.

Sources

  1. OpenAI and Hugging Face partner to address security incident during model evaluation
  2. Security incident disclosure — July 2026