最新模型

新模型、開放權重、多模態、語音、影像與模型架構。

AI 可解釋性

SAEVerbalizer Turns Feature Directions Directly Into Text, but Its Best Global Agreement Rate Is Still Only 56.1%

SAEVerbalizer injects sparse autoencoder decoder directions into Gemma 3 and trains the model to generate feature explanations directly, eliminating the need to search for highly activating examples for each feature. The 27B version achieved 56.1% Reference Agreement on the stricter global test, but the reference answers were themselves model-generated and cannot yet be treated as mechanistic ground truth.

最新模型

DreamX-Phi Constrains Dual-Arm Video Prediction with SE(3) Trajectories, Temporarily Ranks First on WorldArena 2.0

DreamX-Phi injects the rigid-body transformations of two robotic arms directly into attention and constrains video generation using depth, object masks, and V-JEPA features. It scored 60.65 on a WorldArena 2.0 snapshot, but its weights and inference code will not be released until the challenge concludes, and generalization to real robots remains unverified.

最新模型

SAEs Independently Select Their Highest-Activation Tokens, Inflating Cross-Dictionary Causal Variance From Near Zero to 11.9%

A new study finds that sparse autoencoder ablation evaluations typically allow each dictionary to select its own highest-activation token, meaning ostensibly identical latents are tested at different positions. After fixing a shared position, the 7.6% and 11.9% of variance previously attributed to dictionary differences in controlled experiments nearly disappeared.

最新模型

LittleLearner Limits Pretraining Knowledge to a Fifth-Grade Level, With Few-Shot Prompting on Advanced Math Still Stuck at Around 6%

Researchers filtered 88 billion tokens of K–5 material from FineWeb‑Edu and trained 0.6B, 1.3B, and 5B models from scratch alongside compute-matched control models. Experiments show that scaling the models, applying SFT+GRPO, and providing in-context examples primarily elicit existing capabilities rather than clearly pushing beyond the pretraining knowledge boundary.

AI 安全

SPP Instills Value Reflection From the First Token, Widening the 3B Model’s OOD Risk Gap to 19 Points

Synthetic Persona Pretraining embeds first-person reflections generated from a “values constitution” into roughly 10% of pretraining documents, then uses post-training to bind that persona to the assistant identity. Newly released full experiments, weights, and data show that early intervention mainly improves value generalization, while resisting conventional jailbreaks may not require training from scratch.