Skip to content

Add max_loaded_models server option with LRU eviction of idle models - #298

Merged
0xShug0 merged 1 commit into
0xShug0:mainfrom
SelfRef:feat/max-loaded-models
Aug 22, 2026
Merged

Add max_loaded_models server option with LRU eviction of idle models#298
0xShug0 merged 1 commit into
0xShug0:mainfrom
SelfRef:feat/max-loaded-models

Commits

Commits on Aug 22, 2026