AI 可解釋性
SAEVerbalizer Turns Feature Directions Directly Into Text, but Its Best Global Agreement Rate Is Still Only 56.1%
SAEVerbalizer injects sparse autoencoder decoder directions into Gemma 3 and trains the model to generate feature explanations directly, eliminating the need to search for highly activating examples for each feature. The 27B version achieved 56.1% Reference Agreement on the stricter global test, but the reference answers were themselves model-generated and cannot yet be treated as mechanistic ground truth.