Skip to content

Add "Cached Tokens" widget and metrics #397

@ndaidong

Description

@ndaidong

I've been using Bifrost and considering GoModel as a replacement.
I prefer GoModel's minimalist UI but miss Bifrost's cached-token stats.

Image

Proposal:

  • In Usage Overview, add a new widget "Cached Tokens".
  • In Daily Token Usage chart, add a new line for total cached tokens
  • In Usage Analytics / Token Usage by Model, add new column for cached tokens (table mode)

Metadata

Metadata

Labels

enhancementNew feature or request
No fields configured for Feature.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions