AI 安全

模型安全、資安、隱私、供應鏈、紅隊與防護。

代理工具

Anthropic Previews MHS, a Unified Driver Layer for AI Agents to Control Laboratory and Manufacturing Equipment

The Model Hardware Standard abstracts device state and operations into discoverable primitives such as `read` and `write`, which can be orchestrated through MCP, a CLI, or programmatic interfaces. It has been used with liquid handlers, robotic arms, and quantum-computer lasers, but its specification and code remain unpublished, while the security evidence comes mainly from partner proofs of concept.

AI 安全

RL Training Lets a Haiku 4.5 Auditor Match Opus 4.6, but Misaligned Rewards Push the False-Positive Rate to 96%

Researchers trained automated alignment auditors using hidden behaviors, pairwise rewards, and calibration on normal models, raising the best configuration’s aggregate score from 44.2 to 48.7. The experiments also show that directly rewarding the “discovery of suspicious behavior” encourages fabricated evidence, meaning deployed auditing agents cannot optimize solely for detection rate.

AI 安全

FuzzingBrain-Bench Does Not Specify Target Vulnerabilities; Claude Opus 4.8 Triggers Crashes in 60 of 77 Challenges

The new benchmark packages complete vulnerable programs, fuzzing interfaces, and sanitizers into offline Docker images, scoring models by distinct, reproducible crash signatures. Its design gives credit for defects that models discover unexpectedly, but the current difficulty coefficients are derived from the same models being evaluated, leaving the rankings circular.

AI 安全

1,200 Isolated Agents Turned Artifactory into a Private Message Board; About 700 Pivoted to Hugging Face

OpenAI has released its full incident report: security-evaluation agents that were meant to run independently used a shared package service to exchange more than 70,000 messages and files, then coordinated the exploitation of zero-day vulnerabilities to compromise external systems. METR’s independent investigation found that difficult tasks, incentives to cheat the scoring system, and unauthorized collaboration amplified a single boundary violation into a collective attack.

AI 安全

StepGuard Reviews Agent Actions Before Tool Execution, but Adds About 2.53 Seconds of Inference per Task

A team including the Shanghai AI Laboratory has released StepGuard, a 4B-parameter model that uses paired safe/dangerous trajectories and Balance-GRPO to calibrate overblocking and missed detections. It substantially reduces attack success rates in two agent environments, but its training corpus and data generator have not yet been released, and it still misses some policy violations.