Skip to content

feat(litellm): add litellm extension - #30115

Open
Lp-Francois wants to merge 4 commits into
raycast:mainfrom
Lp-Francois:ext/litellm
Open

feat(litellm): add litellm extension#30115
Lp-Francois wants to merge 4 commits into
raycast:mainfrom
Lp-Francois:ext/litellm

Conversation

@Lp-Francois

@Lp-Francois Lp-Francois commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Description

TLDR: At work, we use liteLLM as our AI gateway, this extension will be very useful to track the daily usage and month-to-date usage to be careful of tokens consumption.

PS: yes liteLLM icon is really just the bullet train emoji 🚅 (https://www.litellm.ai/) 😭


Adds LiteLLM, an extension to track your LiteLLM proxy usage: spend, tokens, and requests, etc without leaving Raycast.

LiteLLM is an open-source (GitHub, docs) LLM gateway/proxy that gives you a single OpenAI-compatible endpoint in front of 100+ model providers (OpenAI, Anthropic, Bedrock, Gemini, Azure, and more). Teams run a LiteLLM proxy to centralize API keys, set per-user budgets, and track cost across every model. This extension surfaces that per-key usage data (normally only visible in the LiteLLM dashboard) directly in Raycast.

It contains bother a Usage command and a Menu bar item.

Screencast

Simple recording:

Screen.Recording.2026-08-10.at.16.15.07.mov
Screen.Recording.2026-08-10.at.16.20.45.1.mov

Screenshots:

Raycast 2026-08-10 15 24 40 Usage: Raycast 2026-08-10 15 24 28 Share usage (to brag with the team) Raycast 2026-08-10 15 33 21

Menu bar:
Screenshot 2026-08-10 at 15 45 08

Checklist

- chore: rename store screenshots and add share-usage shot
- feat: hide zero-spend or zero-request models from shared usage
- chore: add screenshots and changelog for Raycast Store submission
- feat: add LiteLLM usage tracking Raycast extension
@raycastbot

Copy link
Copy Markdown
Collaborator

Congratulations on your new Raycast extension! 🚀

We're currently experiencing a high volume of incoming requests. As a result, the initial review may take up to 15 business days.

Once the PR is approved and merged, the extension will be available on our Store.

@Lp-Francois Lp-Francois changed the title Add litellm extension feat: add litellm extension Aug 10, 2026
@greptile-apps

greptile-apps Bot commented Aug 10, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

The PR adds a LiteLLM extension for viewing daily and month-to-date usage from Raycast.

  • Adds Usage and menu-bar commands with spend, token, request, budget, and per-model breakdowns.
  • Adds credential-aware key-info caching, sharing actions, retry handling, extension metadata, and documentation.

Confidence Score: 5/5

The PR appears safe to merge.

No blocking failure remains.

Important Files Changed

Filename Overview
extensions/litellm/src/lib/litellm.ts Implements LiteLLM requests, pagination, aggregation, formatting, and credential-scoped key-info caching; the previously reported cache and preference-type issues are fixed.
extensions/litellm/src/usage.tsx Adds the detailed usage view, budget and key information, refresh behavior, and shareable usage summaries.
extensions/litellm/src/menu-bar-usage.tsx Adds a periodically refreshed menu-bar summary with daily and monthly usage and navigation actions.
extensions/litellm/package.json Defines the two commands, generated preference schema, supported platforms, metadata, and dependencies.

Reviews (4): Last reviewed commit: "fix: add red tier for spend at or above ..." | Re-trigger Greptile

Comment thread extensions/litellm/src/lib/litellm.ts Outdated
Comment thread extensions/litellm/src/lib/litellm.ts Outdated
…references type

Addresses Greptile review on raycast#30115:
- fetchKeyInfoCached now keys the cache by a hash of baseUrl + virtual key,
  so switching proxy/key no longer surfaces another key's budget info
- remove the local Preferences interface in favour of the generated global type
The monorepo tsc --noEmit check has no @types/node, so importing node:crypto
failed CI. Use a small FNV-1a hash instead (only namespaces the key-info cache).
@Lp-Francois
Lp-Francois marked this pull request as ready for review August 10, 2026 13:55
@Lp-Francois Lp-Francois changed the title feat: add litellm extension feat(litellm): add litellm extension Aug 10, 2026
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants