Skip to content

docs: refresh eager-kernels mindmap after Panama Q6_K (#720) #723

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
michalharakal merged 1 commit into from
Jun 9, 2026
Merged

docs: refresh eager-kernels mindmap after Panama Q6_K (#720) #723

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 4 additions & 6 deletions docs/eager-execution-backends-and-kernels.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ mindmap
FP32 BF16 Q8_0 Q4_0 ✅
Q4_K ✅
Q5_1 Q5_0 ✅ new
Q6_K 🚧 legacy SIMD path
Q6_K ✅ new
Native FFM ✅
JVM only — C kernels via CMake
FP32 BF16 Q8_0 Q4_0 Q4_K ✅
Expand All @@ -44,8 +44,7 @@ mindmap
JS and WASM ✅ scalar only
Gaps and roadmap
Native FFM Q5 and Q6_K ❌ issue 708
Native SIMD on linux ❌
Panama SPI Q6_K kernel 🚧
Native SIMD on linux ❌ issue 722
Q5_K Q2_K Q3_K IQ4 packed ❌ dequant only
GPU backends IREE Metal ❌ future
```
Expand All @@ -59,7 +58,7 @@ mindmap
| Q8_0 | ✅ | ✅ | ✅ |
| Q4_0 | ✅ | ✅ | ✅ |
| Q4_K | ✅ | ✅ | ✅ |
| Q6_K | ✅ | 🚧 legacy `JvmQuantizedVectorKernels` (no SPI kernel) | ❌ |
| Q6_K | ✅ | ✅ | ❌ |
| Q5_1 | ✅ | ✅ | ❌ |
| Q5_0 | ✅ | ✅ | ❌ |
| Q5_K / Q2_K / Q3_K / Q8_K / IQ4 | ❌ (dequant-to-FP32 only) | ❌ | ❌ |
Expand All @@ -82,9 +81,8 @@ those formats were JVM-only and broke on Native.

## In progress / missing (with trackers)

- 🚧 **Q6_K Panama SPI kernel** — Q6_K is SIMD on JVM via the legacy `JvmQuantizedVectorKernels.matmulQ6_KVec`, but has no `PanamaVectorQ6KMatmulKernel`/`KernelProvider.matmulQ6K()` SPI entry yet.
- ❌ **Native FFM Q5_1/Q5_0/Q6_K** — the C kernel set covers FP32/BF16/Q8_0/Q4_0/Q4_K only. Tracked by **SKaiNET#708** (core kernel) and **SKaiNET-transformers#170** (converter wiring).
- ❌ **Native SIMD on linux** — Kotlin/Native linux targets run the scalar floor; no cinterop/OpenBLAS or SIMD path. (Apple has Accelerate for dense ops.)
- ❌ **Native SIMD on linux** — Kotlin/Native linux targets run the scalar floor; no cinterop/OpenBLAS or SIMD path (Apple has Accelerate for dense ops). Tracked by **SKaiNET#722**.
- ❌ **Other GGML quant formats** (Q5_K, Q2_K, Q3_K, Q8_K, IQ4_NL/XS) — loadable via dequant-to-FP32, but no packed matmul kernel.
- ❌ **Non-CPU eager backends** (IREE, Metal, GPU) — the `KernelProvider` SPI anticipates them, but none are implemented for the eager path today.

Expand Down
Loading