---
issue: 3
status: done
tags: training
---
# small-distilled

Distil the pretrained model into a quarter of its size.

## What happened

- 2026-10-16: 0.781 F1 (+0.168 on the baseline)

## Next

Most of the F1 at a fifth of the cost.