GitHub Repo
Transformers Proposes Unified Quantization Architecture; MXFP4 Migration Could Change Loading Behavior on Older GPUs
On October 20, Transformers maintainers proposed a shared block quantization architecture covering formats such as FP8 and MXFP4, along with mixed-precision loading. The MXFP4 draft also raises the hardware requirements for quantization kernels, potentially changing execution on A100, T4, and CPU; it has not yet been merged.