---
issue: 5
status: working
tags: model, training
---
# sparse-attn-schedule

Block-sparse attention with a batch-size schedule.

## What happened

- Started.

## Next

A shorter warm-down.