Skip to content

INT-279: add provider: fireworks-ai - #5607

Merged
caiotheodoro merged 3 commits into
mainfrom
caiotheodoro/int-279-fireworks-ai
Oct 22, 2026
Merged

caiotheodoro merged 3 commits into
mainfrom
caiotheodoro/int-279-fireworks-ai

Conversation

@caiotheodoro

@caiotheodoro caiotheodoro commented Oct 19, 2026 •

Copy link
Copy Markdown
Contributor

Adds providers/fireworks-ai (INT-279). The gateway integration is in https://github.com/truefoundry/tfy-llm-gateway/pull/4360 (with the control plane in https://github.com/truefoundry/servicefoundry-server/pull/11921); per CONTRIBUTING this should merge after them.

  • default.yaml and 15 models priced from the Fireworks serverless pricing page: kimi-k3, glm-5p3, glm-5p3-flash, qwen3p8-max, minimax-m3, deepseek-v4p1-flash, deepseek-v4p1-flash-1017, gpt-oss-120b, the qwen3-embedding-8b embedding model, the US-only routers (-us, listed at 1.5x) and the Fast routers (-fast).
  • Standard tier, global region only; Priority rates are not modelled. Context window, tool support and image input come from Fireworks' GET /inference/v1/models. The -us routers reuse the base model's values and are named on the US-only page, not in that listing.
  • Embedding price: the pricing page row is "Qwen3 8B", matched to qwen3-embedding-8b by name.
  • ./.github/test/validate.sh passes on all files and npm run build:json lists fireworks-ai: 15 models.

Note

Low Risk
Additive provider YAML only; no runtime, auth, or billing logic changes in this repo.

Overview
Introduces the fireworks-ai provider catalog under providers/fireworks-ai/, with provider-level docs in default.yaml and 15 active serverless models (per npm run build:json).

Chat models include DeepSeek V4.1 Flash (base + 1017), GLM 5.3 / 5.3 Flash, Kimi K3, Qwen3.8 Max, MiniMax M3, and GPT-OSS 120B, each with standard-tier token pricing (including cache-read where applicable), context limits, function_calling where supported, and text/image input where applicable. Routers add US-only variants (-us, ~1.5× pricing) and fast tiers (-fast) for GLM 5.3 and Kimi K3. qwen3-embedding-8b is the sole embedding entry (text → embedding, input-only pricing).

Pricing and capabilities are sourced from Fireworks serverless pricing and model APIs; Priority tier and non-global regions are not modeled. Intended to land after related gateway/control-plane PRs (INT-279).

Reviewed by Cursor Bugbot for commit 0141680. Bugbot is set up for automated code reviews on this repo. Configure here.

Adds providers/fireworks-ai with default.yaml and 15 models priced from the
Fireworks serverless pricing page (standard tier, global region): kimi-k3,
glm-5p3, glm-5p3-flash, qwen3p8-max, minimax-m3, deepseek-v4p1-flash,
deepseek-v4p1-flash-1017, gpt-oss-120b, the qwen3-embedding-8b embedding
model, the US-only routers (kimi-k3-us, deepseek-v4p1-flash-us, glm-5p3-us,
glm-5p3-flash-us) and the Fast routers (kimi-k3-fast, glm-5p3-fast).
@github-actions

Copy link
Copy Markdown
Contributor

SDK live feature checks

Result: failed (15/15 scenarios)

Informational — does not block merge.

Model Pass Fail
fireworks-ai/accounts/fireworks/models/deepseek-v4p1-flash-1017 0 1
fireworks-ai/accounts/fireworks/models/deepseek-v4p1-flash 0 1
fireworks-ai/accounts/fireworks/models/glm-5p3-flash 0 1
fireworks-ai/accounts/fireworks/models/glm-5p3 0 1
fireworks-ai/accounts/fireworks/models/gpt-oss-120b 0 1
fireworks-ai/accounts/fireworks/models/kimi-k3 0 1
fireworks-ai/accounts/fireworks/models/minimax-m3 0 1
fireworks-ai/accounts/fireworks/models/qwen3-embedding-8b 0 1
fireworks-ai/accounts/fireworks/models/qwen3p8-max 0 1
fireworks-ai/accounts/fireworks/routers/deepseek-v4p1-flash-us 0 1
fireworks-ai/accounts/fireworks/routers/glm-5p3-fast 0 1
fireworks-ai/accounts/fireworks/routers/glm-5p3-flash-us 0 1
fireworks-ai/accounts/fireworks/routers/glm-5p3-us 0 1
fireworks-ai/accounts/fireworks/routers/kimi-k3-fast 0 1
fireworks-ai/accounts/fireworks/routers/kimi-k3-us 0 1

Failures

  • fireworks-ai/accounts/fireworks/models/deepseek-v4p1-flash-1017 setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/deepseek-v4p1-flash setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/glm-5p3-flash setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/glm-5p3 setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/gpt-oss-120b setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/kimi-k3 setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/minimax-m3 setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/qwen3-embedding-8b setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/models/qwen3p8-max setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/deepseek-v4p1-flash-us setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/glm-5p3-fast setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/glm-5p3-flash-us setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/glm-5p3-us setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/kimi-k3-fast setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)
  • fireworks-ai/accounts/fireworks/routers/kimi-k3-us setup: provider not in SDK live harness registry (add providers.ts + GitHub secret)

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 0141680. Configure here.

Comment thread providers/fireworks-ai/accounts/fireworks/models/qwen3p8-max.yaml
@caiotheodoro
caiotheodoro merged commit 209a66c into main Oct 22, 2026
5 checks passed
@caiotheodoro
caiotheodoro deleted the caiotheodoro/int-279-fireworks-ai branch October 22, 2026 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants