Archive
Agent、MCP、coding agent、工作流自動化與評測。
代理工具
Scale AI treats prompts, tools, memory, and control flow as model-modifiable code, then measures real-world gains using a hidden test set. Across 111 experiments, native coding agents did not consistently outperform a shared harness, while the best validation scores generally proved overly optimistic.
代理工具
Rather than retaining every executable synthetic task, CalibForge repeatedly revises tasks until different solver agents exhibit predefined success and failure patterns. Two models fine-tuned on calibrated trajectories improved across three coding-agent benchmarks, but full training required 64 NVIDIA H20 GPUs, and some results were based on only a single run.
AI 安全
A new benchmark uses four paired contexts to distinguish whether models correctly evaluate evidence or simply ignore all external information. By changing only the configuration of DPO preference data, SCOPE reduces answer flips caused by misleading contexts while preserving accuracy in correct and irrelevant contexts.
時間序列與檢索增強
Baidu researchers have adapted RAG from text generation to multivariate time-series forecasting, using a TCN to retrieve similar segments and cross-attention to fuse them. A channel-dependent variant outperformed the listed baselines across six datasets, but the code has not been released, and maintainers have warned that the conventional benchmarks used may no longer be sufficiently discriminative.
最新模型
An expanded version of Low Frequency Trap uses 2,190 programmable videos to measure event count and frequency separately. Gemini 3.6 Flash’s ball-bounce counting accuracy improves with increased sampling, but its timestamp-sequence F1 score is only 3.7%.
最新模型
A new study uses counterfactual cropping to test six open models, distinguishing between “calling a tool” and “the tool’s returned content actually changing the answer.” Most positive gains are concentrated in a small number of well-calibrated trajectories, suggesting that final accuracy alone may overstate visual tool capabilities.
代理工具
During training, EnvACE does not query external environments. Instead, the same policy alternates between generating tool actions and imagined environment responses. This reduces reliance on executable training environments, but also directly absorbs simulation errors into the agent’s parameters.
硬體
MicroEvo combines processor-design knowledge, Pareto tree search, and historical PPA feedback to find performance, power, and area trade-offs with fewer simulations. Its maximum hypervolume gain of 36.2% comes from a simulated design space and should not be equated with improvements in physical silicon.
推論系統
PaDoc decodes the layout sequence and each region’s content in parallel while sharing the page prefix, avoiding serialization of the entire document into a single path. Its 2.1B model maintains a 94.24 Overall score on OmniDocBench, though the performance figures come from a single GPU under specific scheduling settings.
3D 生成與具身 AI
iARCS first corrects collisions and walkability issues in an indoor scene generator, then compiles natural-language requirements into executable reward functions for a second stage of reinforcement learning. In 3D-FRONT experiments, it outperforms MiDiffusion on geometric metrics, but each new requirement requires a separately trained LoRA, and the authors have not yet released an implementation.
代理工具
Ai2 built a replayable evaluation from 462 real math tutoring transcripts, asking models to choose between providing scaffolding and requiring deeper student reasoning. Explicitly prompting for this tradeoff improves the performance of all seven models, but simulated students and model-based grading still cannot demonstrate real learning outcomes.
代理工具
Successful demonstrations may not apply to states reached after an agent takes a detour, and unconditionally providing the full trajectory can even reduce the probability of the correct action. SMRC-SD adds a self-distillation signal only when the state is compatible with a demonstration step, outperforming the full-path baseline on both ALFWorld and WebShop.