Skip to content

feat(chat): surface model capacity queue progress on the waiting indicator - #78

Merged
luoxuanzao merged 1 commit into
mainfrom
feat/model-queue-indicator
Sep 20, 2026
Merged

luoxuanzao merged 1 commit into
mainfrom
feat/model-queue-indicator

Conversation

@luoxuanzao

Copy link
Copy Markdown
Member

Summary

  • Consume the CLI's model_queue_status system message (SDK SDKModelQueueStatusMessage): the transform layer maps it to a new model_queue stream chunk, and the thinking/waiting indicator shows the queue position and estimated wait — e.g. Model is queued (3 ahead · ~12s wait)... — in a warning color, restoring the usual flavor wording once the request leaves the queue.
  • Why: model capacity queuing was previously invisible; users saw only the generic waiting line with no hint that the request was queued server-side.
  • Compatibility: purely event-driven. Older CLIs that never emit the subtype keep current behavior (unknown system subtypes were already ignored). Zero-valued queue_count / wait_time_ms are treated as "no data" and not rendered. Nothing is persisted; the status is transient.

Verification

  • npm run typecheck
  • npm run lint
  • npm run test (170 suites / 3602 tests, incl. 2 new transform cases for both queued and ready mappings)
  • npm run build
  • npm run release:check
  • npm run audit:prod
  • Tested affected qodercli behavior against a real CLI when applicable (live Obsidian in dev vault showed the queue indicator during a real queued request; screenshot verified)

Safety

  • No credentials, private vault content, internal URLs, or personal paths are included
  • User-visible changes are documented in CHANGELOG.md

…cator

The CLI emits model_queue_status while a request waits for capacity; the
plugin now maps it to a model_queue stream chunk and shows the position
and estimated wait on the thinking indicator, restoring the usual
wording once the request is ready. Older CLIs that never emit the
subtype are unaffected.

Co-authored-by: QoderAI (Qwen 3.8 Max) <qoder_ai@qoder.com>
@luoxuanzao
luoxuanzao merged commit 484badf into main Sep 20, 2026
10 checks passed
@luoxuanzao
luoxuanzao deleted the feat/model-queue-indicator branch September 21, 2026 00:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant