Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change metrics normalized by input tokens to mixed tokens #6

Open
mr-september opened this issue Dec 4, 2024 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@mr-september
Copy link

mr-september commented Dec 4, 2024

The industry tends to use a simplified ratio of 3 output tokens:1 input token for calculated mixed costs per 1M tokens. Many models have substantially lower input costs vs output costs. I agree that this is a much more representative figure of usage costs. Example:

Comparison Deepseek Price Claude 3.5 Sonnet Price Price Ratio
Input Prices $0.14 $3.00 1:21
Output Prices $0.28 $15.00 1:53
Mixed (3:1) $0.245 $12 1:49

Please consider changing it to report by mixed tokens pricing.

P.S. the plot currently labels Deepseek's input price at $0.95, which seems wrong? Deepseek API Pricing

@JonathanChavezTamales JonathanChavezTamales added the enhancement New feature or request label Dec 14, 2024
@JonathanChavezTamales
Copy link
Owner

I will add it to the backlog, I'd probably make a revamp on how pricing is shown overall and will add this too. Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants