推論系統
llama.cpp Reworks Adreno Matrix Multiplication Routing, Speeding Up Prompt Prefill by 9% to 25% Across Two Chip Generations
llama.cpp b10687 avoids inefficient matrix multiplication paths selected by the OpenCL compiler on Snapdragon X2 and older A7X GPUs. Maintainers measured prompt-prefill speedups of roughly 20% to 25% for gpt-oss-20b and 9% for Gemma 3n, while per-token decoding saw no improvement.