Local-first chat agent that runs comfortably with small-context local LLMs (from 2B) without losing the original goal of a long conversation. Multi-window context with rollovers, SKILL.state runtime, memory carry-over, three-tier auto web search, and a stalled-session detector. Next.js + FastAPI + SQLite + LanceDB, packaged for Docker Compose.
python typescript sqlite mcp nextjs ai-agents rag fastapi ai-agent local-llm retrieval-augmented-generation lancedb context-window local-agent model-context-protocol session-memory chat-agent small-context
-
Updated
Sep 3, 2026 - Python