Lean audit finds floating-point rounding bugs in PyTorch, JAX and TensorFlow operators
Start here
A Lean-based audit of 162 TorchLean operator entries, checked against PyTorch, JAX, TensorFlow, NumPy, CuPy, ONNX Runtime and MLX over roughly 780 million outputs, found floating-point rounding bugs in widely used code, including PyTorch, JAX, TensorFlow Probability, diffusers, PyTorch Geometric and xLSTM; several of the bugs had never been reported before. In the Lean sweep, 57,547 outputs (96.8%) matched the exact result rounded once, while 1,329 matched TorchLean's specified sequence of rounded operations. The audit builds on FloatLib, a Lean library for arbitrary-precision floating-point arithmetic whose roundoff tactic proves error bounds. The author notes that proving a formula correct over the reals does not establish its floating-point accuracy.
Generated from reports · updated 20 h ago
Report timeline
Follow the reports to see the event from different sides.
- Hacker News · AILean-based audit finds rounding bugs in softmax and other operators across PyTorch, JAX and TensorFlow
A Lean-based audit of 162 TorchLean operator entries, compared against PyTorch, JAX, TensorFlow, NumPy, CuPy, ONNX Runtime and MLX across roughly 780 million outputs, turned up floating-point rounding bugs in widely used code including PyTorch, JAX, TensorFlow Probability, diffusers, PyTorch Geometric and xLSTM, several never reported before. In the Lean sweep, 57,547 outputs (96.8%) matched the exact result rounded once, while 1,329 matched TorchLean's specified sequence of rounded operations. The work builds on FloatLib, a Lean library for arbitrary-precision floating-point arithmetic whose roundoff tactic proves error bounds, and the author notes that proving a formula correct over the reals does not establish its floating-point accuracy.
Heat for this event
- Current, comparable range
- 6
- Peak, comparable range
- 10November 17 13:00
- Change in 24 hours
- –
The trend compares the same participants over hours observed continuously, so its range can be narrower than the current heat count. Hover or tap the chart for hourly heat; the arrow keys move through it.