GitHub Repo
PyTorch Community Reports CPU Logit Precision Issue That Can Halve Results Near 0.5 with Half-Precision Inputs
A PyTorch 2.14 CPU community reproduction on October 6 found that rounding in intermediate logit calculations may cause about 50% relative error for certain half-precision inputs. The report includes an exhaustive enumeration of inputs and proposed patch code, but the patch has not been validated in an actual build.