Skip to content

catalog: add Recursive Flint (MLX INT4 and GGUF UD-Q4_K_XL) - #215

Merged
Siddhesh2377 merged 3 commits into
mainfrom
siddhesh/flint-catalog
Oct 21, 2026
Merged

Siddhesh2377 merged 3 commits into
mainfrom
siddhesh/flint-catalog

Conversation

@Siddhesh2377

@Siddhesh2377 Siddhesh2377 commented Oct 21, 2026 •

Copy link
Copy Markdown
Collaborator

Adds Recursive Flint, a 40B-total / 2.5B-active MoE coding model (Apache-2.0), as two catalog rows that share the flint merge key.

Id Backend Artifact Size
mlx-flint-int4 MLX RecursiveSI/flint-int4 (11 files) 22.6 GB
flint-ud-q4_k_xl llama.cpp unsloth/flint-GGUF UD-Q4_K_XL 25.1 GB

Both are mirrored into runanywhere/decision-models-stable-fork (mlx/flint-int4/ and gguf/flint/). Every URL is pinned to its upload commit, and every weight file carries its SHA-256. The MLX checksums come from the checkpoint's own flint-int4.json, and I checked them against the uploaded files.

The golden outputs for models list --all (plain and --json) each gain the one merged flint row and change nothing else.

MLX needs mlx-swift-lm 3.31.13, which is in runanywhere-sdks#1150. Built against that branch through WALLY_SDK_SWIFT_PATH, wally models show mlx-flint-int4 resolves all 11 files. I haven't run a generation through wally yet, so the MLX row is untested end to end. The GGUF row lists and downloads, but it can't load until the C++ kit's llama.cpp supports Flint's architecture. The new kit pins will land in this PR once that kit is released, so don't merge before then.

ctest passes (6/6, including the golden corpus) and cargo fmt --check is clean.


Summary by cubic

Adds Recursive Flint, a 40B-total / 2.5B-active MoE coding model (Apache-2.0), as two catalog rows sharing the flint merge key: MLX INT4 and GGUF UD-Q4_K_XL. Bumps the cpp-desktop kit to 0.20.42, which adds llama.cpp Flint support so the GGUF row can now load, and regenerates sys bindings and version goldens.

The MLX row is untested end to end; no generation was run through wally.

Written for commit 6d30c99. Summary will update on new commits.

View guided diff Turn on auto-fix

Summary by CodeRabbit

  • New Features

    • Added the Recursive Flint 40B-A2.5B INT4 language model to the catalog.
    • Added MLX and GGUF model formats with download metadata, checksums, and a 262,144-token context window.
    • The model is available through the MLX/llama.cpp backend and is initially marked as not downloaded.
  • Chores

    • Updated desktop kit and macOS release references to version 0.20.42.

@coderabbitai

coderabbitai Bot commented Oct 21, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 6115eff5-34eb-4c2c-9628-23bf824425dd
📥 Commits

Reviewing files that changed from the base of the PR and between 1610c94 and 6d30c99.

📒 Files selected for processing: 10
  • .github/workflows/ci.yml
  • .github/workflows/release.yml
  • src/catalog/catalog.rs
  • src/sys/bindings.rs
  • tests/golden/expected/local__models__list__--all.stdout
  • tests/golden/expected/local__models__list__--all__--json.stdout
  • tests/golden/expected/version__--json__version.stdout
  • tests/golden/expected/version__version.stdout
  • tests/golden/expected/version__version__--json.stdout
  • versions.toml

Included review availability: This review used your included allowance. Your plan provides up to 4 included reviews per hour; 1 remain after this review.

📝 Walkthrough

The pull request adds Recursive Flint model artifacts and catalog entries for MLX and llama.cpp. It also updates the C++ kit version, the Swift CI source reference, macOS workflow checkout pins, and related expected version output.

Changes: Recursive Flint Catalog

Layer / File(s) Summary
Artifact metadata
src/catalog/catalog.rs
Adds pinned MLX INT4 and GGUF artifact inventories with file sizes and SHA-256 checksums.
Model entries and expected listings
src/catalog/catalog.rs, tests/golden/expected/local__models__list__--all.stdout, tests/golden/expected/local__models__list__--all__--json.stdout
Adds MLX and llama.cpp entries for Recursive Flint with a shared merge key, 262144-token context, and thinking support. The expected model listings include the flint model.

SDK Pin Update

Layer / File(s) Summary
SDK version references and expected output
versions.toml, src/sys/bindings.rs, tests/golden/expected/version__--json__version.stdout, tests/golden/expected/version__version.stdout, tests/golden/expected/version__version__--json.stdout
Updates the C++ kit pin and Swift CI reference. Generated binding provenance and expected version output now reference 0.20.42.
macOS workflow checkout references
.github/workflows/ci.yml, .github/workflows/release.yml
Updates the runanywhere-sdks commit used by the macOS CI and release jobs.

Priority: ⬇️ Low

Estimated code review effort: 2 (Simple) | ~12 minutes

Change: Feature

Suggested reviewers: sanchitmonga22

Merge Risk: ⚪ Minimal · up to 6d30c

This PR adds Recursive Flint as MLX and GGUF catalog entries and bumps the C++ kit pin to 0.20.42. No concrete merge-blocking issue was found. The author notes that MLX generation has not been tested end to end, but the pinned runtime appears to support the model type.

Pre-merge checks: Passed 5
Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly and concisely identifies the main change: adding Recursive Flint catalog entries for MLX INT4 and GGUF UD-Q4_K_XL.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 1…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Docstring Coverage

Explanation

No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 1 files. (9 skipped: 8 unsupported, 1 too large.)

✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@sanchitmonga22 sanchitmonga22 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Limited current-diff review of 6d30c99: the MLX/GGUF catalog entries use commit-pinned artifact URLs and per-file checksums; both remain explicitly harness_compatible=false. The five kit archive checksums match the published cpp-desktop-v0.20.42 release asset digests. CI and release workflows consistently pin the Swift SDK checkout to fa3b7a46ce57c946cccdb31c48e388e1004a6238, matching the kit source. Version goldens and the generated binding header are updated consistently. No obvious blocking defect found in this scoped diff. Approval does not establish release readiness: current-head platform CI is still running and I have not independently validated Flint MLX or GGUF generation with this build. The author description still contains pre-kit caveats and should be reconciled with actual test results. This does not approve or validate Command Code integration or unspecified URL replacements.

@Siddhesh2377

Copy link
Copy Markdown
Collaborator Author

You can run this model via this command
gguf: wally run flint
mlx: wally run mlx-flint

cc: @sanchitmonga22

@Siddhesh2377
Siddhesh2377 marked this pull request as ready for review October 21, 2026 22:29
@Siddhesh2377
Siddhesh2377 requested a review from a team as a code owner October 21, 2026 22:29
@Siddhesh2377
Siddhesh2377 merged commit f37e575 into main Oct 21, 2026
9 checks passed
@Siddhesh2377 Siddhesh2377 mentioned this pull request Oct 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants