Skip to content

Reduce llama.cpp scoring latency - #19

Merged
NotXf1le merged 4 commits into
masterfrom
feature/llama-latency
Sep 24, 2026
Merged

NotXf1le merged 4 commits into
masterfrom
feature/llama-latency

Make missing llama.cpp logprob probes optional

e7975f4
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning and 1 notice
test
succeeded Sep 24, 2026 in 20s