Skip to content

Bundle native Xet transfers with Git LFS - #110

Open
haraschax wants to merge 4 commits into
masterfrom
codex/package-git-xet
Open

haraschax wants to merge 4 commits into
masterfrom
codex/package-git-xet

Conversation

@haraschax

@haraschax haraschax commented Sep 11, 2026 •

Copy link
Copy Markdown

Bundle git-xet into the existing comma-deps-git-lfs wheel so Git LFS gains native Xet uploads and downloads without adding a Python dependency. Build haraschax/xet-core at 3cb5b2bf8e34bca2423a29d3110bb03c22a4a581; the fork supplies the missing download handler and standalone negotiation with current Hugging Face servers.

Build the stripped executable with Rust 1.95 and vendored OpenSSL through the existing wheel pipeline. Both git-lfs and git-xet are exposed as commands; the wheel includes the native executables and Xet license, with no Rust toolchain. Install the Perl module required to build OpenSSL in manylinux, and smoke-test both commands. This supports commaai/openpilot#38831 and commaai/agnos-builder#622.

Validation: built and installed the combined Linux wheel in a clean environment, then downloaded openpilot's 7.5 MB model through the bundled Git LFS 3.6.1 with native reconstruction logged and SHA-256 verified. The fork's 67 tests pass, including native upload/download round trips, token refresh, authentication retries, and corruption checks. Production Rust Clippy passes. CI built the manylinux x86_64/ARM64 and macOS wheels successfully; device image validation remains outstanding.

@haraschax haraschax changed the title Package git-xet for managed Git LFS uploads Package native Git LFS Xet uploads and downloads Sep 11, 2026
@haraschax haraschax changed the title Package native Git LFS Xet uploads and downloads Bundle native Xet transfers with Git LFS Sep 11, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant