nanoGPT speedrun
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
| # | 路线 | minutes to 3.28 ↓ | 对比基线 |
|---|---|---|---|
| 1 | 3.95 | 好 91% | |
| 4 | 10.8 | 好 76% | |
| 5 | 15.2 | 好 66% | |
| 9 | 31.4 | 好 30% | |
| — | 基线 · llm.c GPT-2 (124M) | 45 | 条形从这里开始 |
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
| # | 路线 | minutes to 3.28 ↓ | 对比基线 |
|---|---|---|---|
| 1 | 3.95 | 好 91% | |
| 4 | 10.8 | 好 76% | |
| 5 | 15.2 | 好 66% | |
| 9 | 31.4 | 好 30% | |
| — | 基线 · llm.c GPT-2 (124M) | 45 | 条形从这里开始 |