Skip to content

Claude/index llama shards a2 qzr #52

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
AdaWorldAPI merged 8 commits into from
Mar 30, 2026
+413 −16
Merged

Claude/index llama shards a2 qzr #52

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
25b6d53
Add all-18-shards streaming index test for Llama 4 Maverick BF16
claude Mar 30, 2026
c0d27cc
Add row-wise streaming for large tensors (Maverick OOM fix)
claude Mar 30, 2026
ab3049e
SIMD f64x8 projection + chunked streaming + Rust 1.94 consts
claude Mar 30, 2026
fb9d03b
Derive GOLDEN_STEP from f64::consts::GOLDEN_RATIO at compile time
claude Mar 30, 2026
09728b0
BF16-direct indexer: skip f32, strided octave + halftone projection
claude Mar 30, 2026
8d2d372
Fix rebase duplicates, clean BF16-direct implementation
claude Mar 30, 2026
763351b
F64x8 SIMD 8-row-parallel tensor projection
claude Mar 30, 2026
08c6486
Proper F64x8 SIMD: gather + 8-row batch + mul_add finalize
claude Mar 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion src/hpc/gguf.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -413,7 +413,7 @@ fn dequantize_q4_k<R: Read>(r: &mut R, n_elements: usize) -> Result<Vec<f32>, St
}

/// Convert f16 bit pattern to f32.
fn f16_to_f32(bits: u16) -> f32 {
pub fn f16_to_f32(bits: u16) -> f32 {
let sign = ((bits >> 15) & 1) as u32;
let exp = ((bits >> 10) & 0x1F) as u32;
let mantissa = (bits & 0x3FF) as u32;
Expand Down
Loading
Loading