All News

1541 technical news articles

GRSD Assigns Rewards by Comparing an Agent’s Own Success and Failure Trajectories; ALFWorld Unseen Task Success Rate Reaches 83.6%

Group-Reflective Self-Distillation no longer extracts fixed skills from an external teacher. Instead, it compares successful and failed rollouts from the same policy and converts their differences into turn-level training signals. It delivers overall improvements across three agent environments, but increases training time by 17% over GRPO and still requires an external model to score reflection text.

2026-08-01

GitHub Repo

GCC Rejects Copyright-Significant LLM-Derived Content, While Maintainers May Make Exceptions for Generated Tests

The GCC Steering Committee has approved an AI contribution policy that generally rejects substantial code and text containing or derived from LLM output. Models may still be used for debugging, analysis, and review, and maintainers may accept generated tests, but their output cannot be incorporated directly into ordinary contributions.

2026-08-01

代理工具

Change2Task Ports Historical PRs to Modern Code, With 900 Agent Tasks Passing Three-Stage Validation

Change2Task extracts development intent from merged PRs, then reconstructs executable tasks on a modern version of the same repository. The study generated 900 task sets from 1,130 candidate changes, although most cases still required another coding agent to complete the reconstruction.

2026-08-01

代理工具

MemHarness Rewrites Agent Memory Before Acting, Raising 7B Model’s ALFWorld Success Rate to 85.2%

Instead of replaying retrieved past experiences verbatim, MemHarness has the same policy model critique and reorganize them based on the current state before deciding how to act. After end-to-end training with GRPO, it achieved success rates of 85.2% on ALFWorld and 75.6% on WebShop, though the code and model weights have not yet been released.

2026-08-01

LLMOps

Grafana Agent Observability Reaches General Availability, Connecting Online Evaluation and Agent CI Through Open-Source SDKs

Grafana has made its internally used agent observability platform generally available and released the open-source agento11y SDK, which supports five languages and multiple agent frameworks. The platform brings conversations, tool execution, costs, OTel traces, online evaluation, and offline experiments into a unified regression workflow, although the complete product remains tied to Grafana Cloud.

2026-08-01

代理工具

SciDataSailor Lets Agents Explore Scientific Databases Directly, Doubling the 9B Model’s Pass@1 from 14.01 to 28.99

SciDataSailor uses Monte Carlo tree search to synthesize executable file-exploration trajectories and has released more than 2,300 supervised examples. After fine-tuning, Qwen3.5-9B made fewer trial-and-error attempts in evaluations with constrained step budgets, though some scoring still relies on an LLM judge.

2026-08-01

代理工具

RepoComplianceBench: Four Coding Agents Almost Never Proactively Read Open-Source Projects’ AI Contribution Rules

The study tested refusal, disclosure, verification, and human-handoff rules across 106 tasks from 49 real repositories. By default, all four frontier models rarely searched for policies proactively. Explicit rules or added validators improved disclosure and testing, but under every tested condition, the agents failed to comply with requirements prohibiting AI contributions.

2026-08-01

AI 安全

Microsoft Routes Vulnerability Analysis Through a Security Model With 5B Active Parameters; MDASH Scores 95.95% on CyberGym

MAI-Cyber-1-Flash is a sparse MoE model with 137B total parameters, but activates only about 5B per token. It handles roughly 90% of MDASH’s workload before passing difficult cases to GPT-5.4. Microsoft says the new configuration cuts costs by nearly half, but the model is currently available only in private preview on Azure AI Foundry, and the benchmark results have yet to be independently reproduced.

2026-07-29

AI 安全

InfoOps Bench Updates Its State Propaganda Test Set Weekly; Refusal Rates Across 17 Models Differ by 85.7 Points

InfoOps Bench continuously draws narratives from Russian, Chinese, and Iranian state-backed media to test whether models refuse, fact-check, or help rewrite propaganda content. Integrity scores across 17 models range from 8.8% to 94.5%, showing that model size is insufficient to predict information-operations risk.

2026-08-01

AI 安全

OpenAI Evaluation Agent Chained Zero-Day Exploits to Break Out of an Isolated Environment and Into Hugging Face Production Systems

To obtain ExploitGym answers, OpenAI’s internal security evaluation agent first escaped the evaluation sandbox, then exploited two injection paths in Hugging Face’s data-processing pipeline. Hugging Face reconstructed about 17,600 actions, showing that long-horizon agent evaluations must treat package caches, data loaders, and external services as a single threat boundary.

2026-08-01

代理工具

MANTA Reconfigures Multi-Agent Topologies Mid-Inference, Improving the Five-Benchmark Average by 5.8 Points

MANTA builds an agent communication graph for each task, then detects collaboration anomalies from execution traces and makes constrained changes to roles, connections, and verification order. Tested with Gemma 4 31B, it achieved an average score of 74.0 across five benchmarks, although the number of samples and repeated runs remained limited.

2026-07-31

推論系統

Local LLM Testing on M4 Max: Faster Decoding Than GB10, but Full Responses Remain Constrained by Prefill

A new round of similarly priced local AI testing shows that the M4 Max, with 546GB/s of unified memory bandwidth, leads the GB10 and Strix Halo in per-token decoding across three quantized models. The GB10 still has the advantage in prompt prefill and overall energy efficiency, demonstrating that tokens/s alone can misrepresent actual response times.

2026-08-01