最新模型

新模型、開放權重、多模態、語音、影像與模型架構。

GitHub Repo

Transformers Community Reports RoPE Precision Differences; Converting to bf16 After Loading May Amplify Long-Context Angle Errors

A reproduction case reported on October 4 indicates that converting a model to bf16 after loading may also lower the precision of RoPE frequency buffers, producing results that differ from loading directly in bf16. Maintainers closed a community patch proposal on October 5; the effect on real-model quality and next steps remain to be confirmed.