Skip to content

fix(aws-bedrock-mantle, cohere, sdk-live-test): correct model features and harness gaps flagged by live checks - #5757

Merged
bhaveshpatel640 merged 4 commits into
mainfrom
fix/live-check-remaining-issues
Oct 30, 2026
Merged

bhaveshpatel640 merged 4 commits into
mainfrom
fix/live-check-remaining-issues

Conversation

@bhaveshpatel640

@bhaveshpatel640 bhaveshpatel640 commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Fixes model YAML and harness gaps flagged by the SDK live checks on main (run 40500645771).

Model Change LiteLLM
aws-bedrock-mantle/openai.gpt-oss-safeguard-120b Remove responses mode Match (chat completions only)
cohere/north-mini-code-1-0 Remove tool_choice No data; live check returns 400
aws-bedrock-mantle/google.gemma-4-e2b Remove audio input Match (vision only)
mistral-ai/mistral-medium-2604 None (harness sends prefix: true) Match (assistant_prefill)
openai/gpt-5-mini None (harness raises structured_output cap to 1024) n/a

Test plan

  • yamllint and prettier --check pass on the 3 changed YAMLs; unit tests pass
  • Live run on this branch: 40509739763, all scenarios

Note

Low Risk
Changes are model YAML metadata, informational CI formatting, and live-test request shaping—no runtime gateway or auth paths.

Overview
Aligns provider model metadata with what live SDK checks actually support, and tightens the live-test harness so failures on main stop recurring.

Catalogue fixes: google.gemma-4-e2b drops audio input; openai.gpt-oss-safeguard-120b is chat-only (removed responses mode); cohere/north-mini-code-1-0 no longer advertises tool_choice (live calls return 400).

Harness: withCap accepts a configurable output limit—structured_output uses 1024 tokens when the model has thinking: true, otherwise 64. assistant_prefill sends prefix: true on assistant messages for mistral-ai.

CI comment: SDK live summary markdown adds ✅/❌ on overall results and per-model rows.

Reviewed by Cursor Bugbot for commit be4f642. Bugbot is set up for automated code reviews on this repo. Configure here.

…s and harness gaps flagged by live checks

Co-authored-by: Cursor <cursoragent@cursor.com>
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

SDK live feature checks

Result: ✅ passed (37 scenarios)

Informational — does not block merge.

Model Pass Fail
✅ aws-bedrock-mantle/google.gemma-4-e2b 14 0
✅ aws-bedrock-mantle/openai.gpt-oss-safeguard-120b 15 0
✅ cohere/north-mini-code-1-0 8 0

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit f83b0ca. Configure here.

@bhaveshpatel640
bhaveshpatel640 merged commit e267e79 into main Oct 30, 2026
5 checks passed
@bhaveshpatel640
bhaveshpatel640 deleted the fix/live-check-remaining-issues branch October 30, 2026 07:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants