Skip to content

Live model spending tracker (with consumed usage) #802

Description

@shramee

Feature Description

Show percentage quota consumed in addition to net dollar pricing in the live model spending tracker.

Example

$1.1 spent (5.5% of your quota)
Or for a model with higher usage allotment (e.g. DS v4 Flash on CommandCode or Muse 1.3 on OpenCode):
$1.1 spent (1.8% of your quota)

Context

Pricing vs usage vs consumption is confusing even for the best of us. The pricing strategy is similar for both OpenCode and CommandCode. I believe reason for this might be model providers don't want the their model prices to be shown as lower than a given standard, Pure speculation from my end here though. So there are now two knobs to effectively control the same thing, (controlling how much inference your dollars get you), the model price and the usage allotment.

Solution

Just noticed this in opencode, would be pretty sweet to have in cmdc.

Image

I understand a pure pricing indicator though slightly helpful, doesn't fully resolve the confusion. For example, one might be puzzled why $1.1 spend consumes 6% of usage.

Show percentage quota consumed in addition to net dollar pricing.
$1.1 spent (5.5% of your quota)
Or for a model with more usage (for example DS v4 Flash on commandcode or Muse1.3 on Opencode)
$1.1 spent (1.8% of your quota)

Related Reddit thread: r/CommandCode - https://www.reddit.com/r/CommandCode/s/5T0zQXfXkE

How important is this to you?

Important for my workflow

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions