GitHub Repo

GitHub 熱門專案、開源工具、框架、runtime 與重要 release。

GitHub Repo

Transformers Community Reports RoPE Precision Differences; Converting to bf16 After Loading May Amplify Long-Context Angle Errors

A reproduction case reported on October 4 indicates that converting a model to bf16 after loading may also lower the precision of RoPE frequency buffers, producing results that differ from loading directly in bf16. Maintainers closed a community patch proposal on October 5; the effect on real-model quality and next steps remain to be confirmed.