Optimizing LLM throughput via binned padding, sequence packing, and Flash Attention.
-
Updated
May 11, 2026 - Python
Optimizing LLM throughput via binned padding, sequence packing, and Flash Attention.
To associate your repository with the flash-att topic, visit your repo's landing page and select "manage topics."