nanoGPT speedrun
Train GPT-2 small to a fixed validation loss in as little time as possible (placeholder)
Score: 2026-08-27: 33 minutes to 3.28 (−12 on the baseline)
浏览文件检验
score
+1 −0 routes/tuned-lr-rotary/README.md 查看文件
| @@ -8,6 +8,7 @@ A tuned learning rate, rotary embeddings and a trapezoidal schedule. | ||
| 8 | 8 | ## What happened |
| 9 | 9 | |
| 10 | 10 | - 2026-08-24: 31.4 minutes to 3.28 (−13.6 on the baseline) |
| 11 | +- 2026-08-27: 33 minutes to 3.28 (−12 on the baseline) | |
| 11 | 12 | |
| 12 | 13 | ## Next |
| 13 | 14 | |