Skip to content

open-webui function designed to manage and calculate the costs associated with user interactions and model usage in a Open WebUI.

License

Notifications You must be signed in to change notification settings

bgeneto/open-webui-cost-tracker

Repository files navigation

open-webui-cost-tracker

This open-webui function is designed to manage and calculate the costs associated with user interactions with models in a Open WebUI appliance. The number of (input and output) tokens, price and other metrics are shown in the message status area of Open Webui interface. This status appear right above the message content (see Fig. below)

image

image

Install

Remember to enable the function globally (or by model):

image

Streamlit App

This repo also provides a streamlit app to read and process the generated costs.json file containing model usage data for every user. The costs-<year>.json file is located in the open-webui data directory.

A screenshot of the simple streamlit app is shown below.

Streamlit app for costs processing

image

About

open-webui function designed to manage and calculate the costs associated with user interactions and model usage in a Open WebUI.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages