-
Notifications
You must be signed in to change notification settings - Fork 563
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement and Document LiteLLM Callbacks #1105
Comments
That would be a great feature. |
@MarkRx Regarding adding dependencies to the docker: I am, in general, careful there. I want to keep the docker small (and in fact aim to clean it up from dependencies that are not needed anymore) Having said that, If you have tried yourself and found useful and easy-to-use one of the tools below, and are willing to share in documentation how to invoke it, we can add it to the docker, and state it as the 'recommended' pr-agent prompt logging for people who are interested. (if all the dependencies are already in litellm, even better ...) |
closing it as done |
LiteLLM supports callbacks to a number of different providers out of the box. These can be used to send prompt data to monitoring tools to track prompt usage and cost.
This is a stub to add support for setting the callbacks and documenting how it can be done.
I will implement this. From my preliminary POC'ing it looks like this can be done in a tool agnostic way since LiteLLM abstracts it away and pulls configuration from environment variables.
The text was updated successfully, but these errors were encountered: