---
issue: 3
status: done
tags: systems
---
# fp16-everywhere

Half precision throughout.

## What happened

- 2026-09-24: the check failed, softmax differs from the reference beyond atol 1e-2

## Next

Fails the tolerance on softmax and cumsum; keep fp32 accumulators.