OSCAR INT2 KV cache: per-head rotations, heterogeneous SWA, MLA latent, and expanded-MHA models - #20
Open
zzz0906 wants to merge 119 commits into
Open
OSCAR INT2 KV cache: per-head rotations, heterogeneous SWA, MLA latent, and expanded-MHA models#20zzz0906 wants to merge 119 commits into
zzz0906 wants to merge 119 commits into
Enhance your code review process with GitHub Actions
GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.
Linux, macOS, Windows, and containers
Matrix builds
Any language
Live logs
Built-in secret store
