All News

1537 technical news articles

AI 可解釋性

SAEVerbalizer Turns Feature Directions Directly Into Text, but Its Best Global Agreement Rate Is Still Only 56.1%

SAEVerbalizer injects sparse autoencoder decoder directions into Gemma 3 and trains the model to generate feature explanations directly, eliminating the need to search for highly activating examples for each feature. The 27B version achieved 56.1% Reference Agreement on the stricter global test, but the reference answers were themselves model-generated and cannot yet be treated as mechanistic ground truth.

最新模型

DreamX-Phi Constrains Dual-Arm Video Prediction with SE(3) Trajectories, Temporarily Ranks First on WorldArena 2.0

DreamX-Phi injects the rigid-body transformations of two robotic arms directly into attention and constrains video generation using depth, object masks, and V-JEPA features. It scored 60.65 on a WorldArena 2.0 snapshot, but its weights and inference code will not be released until the challenge concludes, and generalization to real robots remains unverified.

最新模型

SAEs Independently Select Their Highest-Activation Tokens, Inflating Cross-Dictionary Causal Variance From Near Zero to 11.9%

A new study finds that sparse autoencoder ablation evaluations typically allow each dictionary to select its own highest-activation token, meaning ostensibly identical latents are tested at different positions. After fixing a shared position, the 7.6% and 11.9% of variance previously attributed to dictionary differences in controlled experiments nearly disappeared.

代理工具

VALG Tracks Theorem Rewrites With Typed Proof Graphs; Only 2 of 9 COLT Open Subproblems Retain Their Original Scope

VALG breaks machine learning theory research into problem formalization, proof dependency graphs, local derivations, and multi-perspective review, then determines whether to repair a proof or open a separate relaxed branch based on the level of failure. Across nine COLT 2026 open subproblems, the system produced 22 internally finalized candidates, but only two runs yielded results within the scope of the original problems.

最新模型

LittleLearner Limits Pretraining Knowledge to a Fifth-Grade Level, With Few-Shot Prompting on Advanced Math Still Stuck at Around 6%

Researchers filtered 88 billion tokens of K–5 material from FineWeb‑Edu and trained 0.6B, 1.3B, and 5B models from scratch alongside compute-matched control models. Experiments show that scaling the models, applying SFT+GRPO, and providing in-context examples primarily elicit existing capabilities rather than clearly pushing beyond the pretraining knowledge boundary.

AI 安全

SPP Instills Value Reflection From the First Token, Widening the 3B Model’s OOD Risk Gap to 19 Points

Synthetic Persona Pretraining embeds first-person reflections generated from a “values constitution” into roughly 10% of pretraining documents, then uses post-training to bind that persona to the assistant identity. Newly released full experiments, weights, and data show that early intervention mainly improves value generalization, while resisting conventional jailbreaks may not require training from scratch.

推論系統

RMM Prunes the Matrix Multiplication Contraction Axis Based on Input, Accelerating Llama 3.1 8B Long-Context Inference by Up to 1.40×

Reduced Matrix Multiplication leaves weights unchanged and, based on the column norms of the current activation, computes only the highest-scoring shared dimensions in a matrix multiplication. A100 tests show that gains increase with sequence length, but for short contexts, selection and kernel-launch overhead almost entirely offset the savings.

最新模型

PlayWorld Has Multimodal Agents Control Nine World Models, but the Highest Long-Horizon Consistency Score Is Still Just 2.12/5

PlayWorld uses an agent that observes generated frames and dynamically adjusts control commands, preventing differences in movement magnitude across world models from making fixed trajectories incomparable. Results from 171 scenarios show that although current models can generate fluid visuals, they still struggle to preserve global spatial structure and states that continue evolving outside the field of view.