Skip to content

UI: Add support for calling API endpoints on remote llama-server#24383

Open
niutech wants to merge 3 commits into
ggml-org:masterfrom
niutech:ui-remote-server
Open

UI: Add support for calling API endpoints on remote llama-server#24383
niutech wants to merge 3 commits into
ggml-org:masterfrom
niutech:ui-remote-server

Conversation

@niutech

@niutech niutech commented Jun 9, 2026

Copy link
Copy Markdown

Overview

This PR allows the web UI to call API endpoints on remote llama-server, by optionally setting API_BASE and API_KEY settings in the UI. Implements #22531.

Additional information

In order to test it:

  1. Run public instance of llama-server on https://example.org (optionally with --api-key)
  2. Go to tools/ui and run npm run build && npm run preview
  3. Open http://localhost:4173/#/settings, set API Base to https://example.org and optionally your API Key, then save settings
  4. Chat with a remote llama-server

Screenshot

Settings

Requirements

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants