All News

1491 technical news articles

GitHub Repo

Transformers Community Proposes RoPE Configuration Compatibility Fix; Legacy Overrides May Lose Model Base Parameters

An October 12 Transformers report says that applying a legacy `rope_scaling` configuration after initialization may clear existing RoPE base parameters, causing initialization to fail or a reload to use default values. The proposed fix includes ten regression tests, but has not been merged; maintainers have also questioned whether users should migrate to the newer configuration interface.

GitHub Repo

Transformers Community Reports Gemma Tensor Parallelism Bug; Mixing Tensor and DTensor May Interrupt Inference

Reports from the October 12–13 Transformers development builds indicate that Gemma 3 and 4 multimodal classes may fail to complete a forward pass under tensor parallelism because of inconsistent tensor types. The report includes a minimal reproduction, and its author points to a proposed fix, but the impact on stable releases and the completeness of the fix remain unconfirmed.