Skip to content

docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B (iPhone / iPad / Mac) - #369

Open
john-rocky wants to merge 1 commit into
OpenBMB:mainfrom
john-rocky:docs-apple-core-ai
Open

docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B (iPhone / iPad / Mac)#369
john-rocky wants to merge 1 commit into
OpenBMB:mainfrom
john-rocky:docs-apple-core-ai

Conversation

@john-rocky

@john-rocky john-rocky commented Sep 4, 2026

Copy link
Copy Markdown

Thanks for the per-backend cookbooks and Agent Skills, and for MiniCPM5-2B. This replaces my earlier README-only note (it conflicted after the 2B release) with the shape the table uses: a cookbook and a paired skill for Apple Core AI, so that "run it in an iPhone / iPad / Mac app" has a route in minicpm5-deploy; the router had no iOS row.

What it adds:

  • docs/deployment/coreai.md and skills/minicpm5-deploy-coreai/SKILL.md: the Swift path through the community CoreAIKit package, Apple's own CoreAILanguageModels path, the conversion recipe, on-device numbers, and pitfalls.
  • minicpm5-deploy: one checkpoint row, one decision-matrix row, one default pick, one line on the sanity check.
  • README.md / README-cn.md: one row in the MiniCPM5-2B deployment table.

The bundle is a community int8 conversion (per-block-32 scales, 2.7 GB), token-exact against fp32 on the checks in its card; measured 22.4 tok/s decode on iPhone 17 Pro and 127.6 tok/s on M4 Max. Validated today end to end: chat-cli --model minicpm5-2b --prompt "1+1=?" answers 1 + 1 = 2. and stops, on both CoreAIKit and Apple's llm-runner.

MiniCPM5-1B is not in this PR. Its current Core AI bundle keeps generating after the answer on that prompt, while the reference checkpoint stops in transformers, so the bundle needs a fix on my side first. I will add the 1B once a corrected bundle is verified. If any wording or placement should be different for this repo, tell me and I will change it. Thanks again.

Adds docs/deployment/coreai.md and skills/minicpm5-deploy-coreai/SKILL.md
(community Core AI .aimodel conversion of MiniCPM5-2B, iPhone / iPad / Mac
in Swift), routes "iPhone / iOS / Swift / Xcode" to the new skill in
minicpm5-deploy, and lists the backend in the MiniCPM5-2B deployment table
of README.md and README-cn.md.
@john-rocky john-rocky changed the title docs: add community Apple Core AI conversion of MiniCPM5-1B docs: Apple Core AI cookbook and Agent Skill for MiniCPM5-2B (iPhone / iPad / Mac) Sep 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant