---
tags: systems
---
# fp8-head

FP8 matmul for the language-model head.

## What happened

- Started.

## Next

A sparser attention schedule.