feat(config): user-tunable context window with log-scale slider#120
Merged
quiet-node merged 21 commits intomainfrom May 2, 2026
Merged
feat(config): user-tunable context window with log-scale slider#120quiet-node merged 21 commits intomainfrom
quiet-node merged 21 commits intomainfrom
Conversation
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
…tegration Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
… and eject Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
9db4279 to
9f10f68
Compare
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
Signed-off-by: Logan Nguyen <lg.131.dev@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
num_ctxsetting with a log-scale slider (2K → 1M) and an editable token chip in the AI tab. Slider thumb visually aligns with tick labels at every doubling, and the value chip reflects the exact selected token count.num_ctxthrough the/searchpipeline so the router and universal judge calls send the same value the chat path and warmup use. Previously these calls omittednum_ctx, causing Ollama to reload the model at its default 4096-token window after the first/searchmessage even when a larger context was configured.[inference]config section and warmup path.Context window slider details
1/9of slider travel doubles the value.i / 9 * 100%with an 8px horizontal margin matching the slider thumb radius, so each label sits under the thumb center at that value.calc(8px + var(--fill) * (100% - 16px) / 100%)instead of at--fill%of full track width.>= 2048; out-of-range values fall back to the previous valid value on blur.Search-path
num_ctxfixRouterOptionscarriesnum_ctx;request_json,call_router_merged, andcall_judgeaccept it as an argument.DefaultRouterJudgeandDefaultJudgecarrynum_ctx, populated fromapp_config.inference.num_ctxinsearch/mod.rs."num_ctx":<value>for both router and judge calls.Test plan
bun run test:all:coverage— 1152 vitest tests + 670 cargo tests pass with 100% line coverage gatebun run validate-build— lint + format + typecheck + frontend + backend release bundle clean/api/psreports the user's configurednum_ctxafter the first/searchmessage (no auto-reset to 4096)-1), and the Unload now button