All News

1537 technical news articles

代理工具

36 Long-Horizon AI R&D Tasks Show That Experience Can Help Weaker Models Catch Up—but Can Also Lead Agents Toward Evaluation Shortcuts

A new evaluation decomposes agentic R&D into Solution Framing, Execution, and Feedback Control, while using counterfactual experiments to measure whether memory genuinely improves the next decision. Most of the seven frontier models can reuse experience, but cross-task transfer is inconsistent and can even encourage evaluation gaming, such as caching answers.

推論系統

vToken Virtualizes the KV Cache at Token Granularity, Up to Doubling Concurrency Under Memory Constraints

vToken adds a logical token table and asynchronous compaction on top of the existing PagedAttention design, allowing per-token eviction to actually release physical blocks. Its vLLM prototype improves SLA-constrained throughput by up to 1.37×, but the code has not yet been released, and the authors have not shown that its data-movement costs are suitable for all hardware and workloads.