Skip to content

feat: LocalModel skill — privacy-preserving local LLM classifier#53

Open
N4M3Z wants to merge 1 commit into
mainfrom
feat/local-model
Open

feat: LocalModel skill — privacy-preserving local LLM classifier#53
N4M3Z wants to merge 1 commit into
mainfrom
feat/local-model

Conversation

@N4M3Z

@N4M3Z N4M3Z commented May 24, 2026

Copy link
Copy Markdown
Owner

Summary

  • New LocalModel skill for routing prompts to a local LLM when privacy demands it instead of sending content to a cloud model
  • classify.py helper: classifies a prompt against a label set using the local backend
  • detect-backend.sh helper: probes for a usable local LLM backend (ollama, llama.cpp server, etc.) and prints the endpoint

Split out of #49 so it ships as a standalone change.

Test plan

  • forge validate passes locally
  • CI green on the PR
  • Spot-check forge install --target ~ --force deploys the skill cleanly
  • Both helper scripts execute (chmod +x preserved through cherry-pick)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant