GitHub Repo
Transformers 5.16 Switches to the DTensor Parallel Backend and Adds NVFP4 and Per-Layer KV Cache Configuration
The latest Hugging Face release replaces the legacy tensor-parallel implementation with DTensor and adds initial pipeline-parallel inference and on-the-fly NVFP4 quantization. The upgrade also changes TP, Fuyu, and certain audio model behaviors, requiring regression testing of existing training and inference pipelines.