推論系統

推論 runtime、量化、 serving、KV cache、成本與效能。

最新模型

ReflectRL Turns Expert Error Trajectories into Training Signals, Improving GRPO Cross-Domain Evaluation by an Average of 19.1 Points

Instead of discarding reasoning trajectories where a strong model produces an incorrect answer, ReflectRL asks the student model to identify localized errors and then gradually removes this hint. The study reports consistent gains across nine benchmarks, although the results come primarily from mathematical reasoning settings, and the listed GitHub project link is currently inaccessible.

AI 安全

Science Reasoning Benchmark Shows “Right Answer, Wrong Method,” With Shortcut Solutions Reaching 37.4% on HLE

A new study finds that models can obtain correct results without completing the required derivation by using shortcuts such as guessing formulas, enumeration, or guessing an answer first and then verifying it. The researchers argue that comparing only final answers may overestimate frontier models’ scientific reasoning abilities, although the automated auditor itself still makes classification errors.

最新模型

Faster-WAM Shrinks the Robot Action Head to a Single Layer, Cutting Control Inference Latency to 66.5 Milliseconds

Faster-WAM attaches a single-layer action head to a 30-layer video Transformer and obtains world-model representations through cross-layer KV fusion, eliminating the need for the action branch to replicate the full backbone depth. The study reports a 3.2× speedup over Fast-WAM, but code and weights for the new architecture have not yet been released, and the results come primarily from simulation benchmarks.

推論系統

xPress Restores Causal Dependencies to Diffusion-Based Drafts, Boosting Qwen3-8B Decoding Throughput by About 1.3× on Average

xPress adds a single parallel causal refinement step between block-diffusion drafts and the target LLM, reducing early rejections caused by drafts in which individual tokens are plausible but the sequence as a whole is not. The study reports an average increase of about 30% in accepted draft length, but no public implementation is currently available for independent reproduction.