推論系統
KVMem Pages Agent History to Memory and NVMe, Letting a 24GB Laptop GPU Address a Million-Token Workspace
Instead of compressing overflow agent history into summaries, KVMem preserves precomputed KV states and loads relevant blocks for each query. The authors demonstrate a logical million-token workspace using Qwen 27B on an RTX 5090 Laptop GPU, though model support and performance figures remain closely tied to their custom runtime.