推論系統
MoNe Writes Long Context into Test-Time Neural Memory, Reducing Total FLOPs for 128K Inference by 81%
Qualcomm AI Research adds per-layer fast weights to a frozen Transformer, absorbing context in 512-token segments so queries no longer need to read the source text. In 128K experiments, Qwen2.5-0.5B maintained fixed memory usage and outperformed ICL and RAG, though the evidence is currently limited to three synthetic retrieval tasks.