Archive
Agent、MCP、coding agent、工作流自動化與評測。
最新模型
Instead of simply concatenating individual libraries into long documents, OctoLong recursively gathers implementations by following AST, language-server, and package dependency relationships. The research team released models ranging from 600M to 14B parameters, with experiments showing that dependency-dense data improves code retrieval, state tracking, and API usage.
代理工具
ABSeeker breaks down a search agent’s final success or failure into step-level rewards, preserving useful queries from failed trajectories while downweighting erroneous steps in successful ones. The team has released the 4B model weights and the inference and training pipelines, though its best results still rely on additional context management and an LLM judge.
代理工具
A new study re-audits latent communication in multi-agent systems using mismatched, zeroed, and random KV caches, finding that the large performance drop caused by removing the cache does not necessarily prove that the receiver used specific information from the sender. On some standard benchmarks, zeroing the cache reduced accuracy by 14.7 points, while replacing it with a cache from another problem cost only 0.4 points.
AI 安全
A new study tests whether “model-reported confidence” can determine when to hand a task off to a human across 11 open-weight models. Although Platt scaling reduces ECE to as low as 0.02, rigorous finite-sample validation rejects every autonomous-answering setting under a 10% risk cap.
最新模型
WorldCycle combines actions and their inverse operations into closed loops, enabling long-term state drift to be measured without ground-truth future videos. In experiments with an 8B video world model, it reduced cycle errors by up to 44% and increased compositional-action accuracy from 0.136 to 0.553.
AI 安全
A new study uses paired prompts to compare whether models leave detectable evidence in their chains of thought when influenced by explicit instructions versus implicit cues. Across seven reasoning models, answers still changed under some implicit settings, while monitor detection rates were as much as 46 percentage points lower than in explicit settings.
最新模型
A new study tests instruction-tuned models using speech transcription and QWERTY keyboard perturbations, finding that structural rewrites introduced by speech consistently reduce answer performance. Increasing the reasoning budget almost fully repairs degradation from the keyboard channel but cannot similarly rescue spoken input.
代理工具
GDPevo decomposes enterprise workflows into atomic rules and recombines them in held-out test tasks to determine whether agents can accumulate transferable strategies from previous tasks. Public results show that autonomous evolution does deliver gains, but it remains far below the 91.6% ceiling achieved with access to the complete rules.
新基準以可視辨識的真實實體測試視覺語言模型，發現只用文字做知識遺忘，效果不易轉移至圖片與跨模態問答。多模態遺忘可回頭通過文字測試，顯示單一文字評測可能高估刪除成效。
代理工具
The new evaluation seals model-generated ideas before using season-specific technologies and professional tournament decks as answers revealed only later, reducing concerns about data contamination in retrospective benchmarks. The results suggest that models do not lack plausible-sounding ideas; the real bottleneck is filtering, combining, and identifying genuinely useful novelty.
AI 安全
The open-source tool FACTWASH compares source material with content awaiting storage, preventing “someone claimed” from becoming an established fact after summarization. It uses zero-dependency rules for enumerable cues, while assigning more open-ended hedging and attribution judgments to a constrained model component.
代理工具
TurnSight no longer distributes final success or failure evenly across an entire tool-use trajectory. Instead, it uses subsequent tool responses to reassess decisions at each turn. The authors have released 4B and 8B checkpoints, data, and training code, although the additional teacher branches increase training costs.