cuda: make graph-cache eviction reachable; qwen3_asr: survive concurrent-load memory pressure - #293

Merged

0xShug0 merged 3 commits into

0xShug0:mainfrom

derekja:fix/cuda-graph-eviction

Aug 22, 2026

Commits on Aug 22, 2026

cuda: export ggml_backend_cuda_clear_graph; qwen3_asr: release graphs before rebuild, exception-safe gallocr

derekja
and
claude
committed
c9613de
cuda: trim idle pool memory and retry when graph allocation fails

derekja
and
claude
committed
cb427c9
framework: make CUDA graph-cache eviction opt-in (default off), qwen3_asr opts in

derekja
and
claude
committed
54b50ad