KernelBench operators
Faster GPU kernels for PyTorch operators, exactly as correct as the reference (placeholder)
Start fused-attention
Browse files+16 −0 routes/fused-attention/README.md added View file
| @@ -0,0 +1,16 @@ | ||
| 1 | +--- | |
| 2 | +issue: 4 | |
| 3 | +status: working | |
| 4 | +tags: systems | |
| 5 | +--- | |
| 6 | +# fused-attention | |
| 7 | + | |
| 8 | +A flash-style attention kernel with an online softmax. | |
| 9 | + | |
| 10 | +## What happened | |
| 11 | + | |
| 12 | +- Started. | |
| 13 | + | |
| 14 | +## Next | |
| 15 | + | |
| 16 | +Search the tile sizes per shape. | |