Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

是否需要增加其他LLM的支持?是否需要支持docker部署方式? #4

Open
Brave-peng opened this issue Jul 31, 2024 · 4 comments

Comments

@Brave-peng
Copy link

感觉这个项目很有趣,大佬有意向的话我可以试试把上面两个补补

@sunls24
Copy link
Owner

sunls24 commented Jul 31, 2024

@Brave-peng 非常感谢认可哦,我这边用的是 one-api,这样可以支持其他 LLM。Docker 部署的话目前是支持的,可以看下 Actions

@Brave-peng
Copy link
Author

看了下code,进一步想请教一下,这边指的one-api,是不是说我如果要使用该服务的话,也需要在本地起一个one-api的服务?

@sunls24
Copy link
Owner

sunls24 commented Aug 4, 2024

目前仅支持 OpenAI 格式的 api 调用,如果想使用其他提供商的,可以搭建一个 one-api 进行转发
https://github.com/songquanpeng/one-api

如果你使用 OpenAI 的调用,那你不需要部署 one-api,直接配置 OPENAI_API_KEY 即可,如果你想使用 Google Gemini 之类的,就可以部署一个 one-api 服务,然后多配置一下 OPENAI_BASE_URL 就可以了。

@Brave-peng
Copy link
Author

非常感谢你的解答,这个对我做相关的部署很有帮助。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants