[FR]: Request to Implement Token Cost Calculation and Logging

[madhankumar2211]

Proposal summary

I would like to propose an enhancement to the project that involves calculating and logging the costs associated with token consumption (both input and output tokens) when using OpenAI's API. This will help users better understand the expenses incurred while interacting with the model.

Motivation

1. Users will have clearer visibility into their usage and costs.
2. Helps in budget management for projects utilizing OpenAI's services.

[jverre]

Hi @madhankumar2211
Agree that this would be very useful, we will try to ship something like this next week. I'll keep you posted on when we start working on it

[Lothiraldan]

Hi @madhankumar2211, we are working on adding Cost tracking in Opik as we speak. Here is a preview of the design that we were came up with. The first version of the cost tracking will includes cost calculation for OpenAI models when doing text generation and we will add more models and use-case in the future. Will that cover your use-case?

[madhankumar2211]

Hi @Lothiraldan, It looks great! This will definitely be helpful in my case.