Skip to content

Latest commit

 

History

History
46 lines (27 loc) · 2.93 KB

free_ai_apis.md

File metadata and controls

46 lines (27 loc) · 2.93 KB
Raw

Free AI APIs

There are APIs offering free access to AI APIs via reverse proxy, and one of the major players, compatible with LibreChat, is NagaAI.

Feel free to check out the others, but I haven't personally tested them: Free AI APIs

NagaAI

Since NagaAI works with LibreChat, and offers Llama2 along with OpenAI models, let's start with that one: NagaAI

⚠️ Never trust 3rd parties. Use at your own risk of privacy loss. Your data may be used for AI training at best or for nefarious reasons at worst; this is true in all cases, even with official endpoints: never give an LLM sensitive/identifying information. If something is free, you are the product. If errors arise, they are more likely to be due to the 3rd party, and not this project, as I test the official endpoints first and foremost.

You will get your API key from the discord server. The instructions are pretty clear when you join so I won't repeat them.

Once you have the API key, you should adjust your .env file like this:

##########################
# OpenAI Endpoint: 
##########################

OPENAI_API_KEY=your-naga-ai-api-key
# Reverse proxy settings for OpenAI: 
OPENAI_REVERSE_PROXY=https://api.naga.ac/v1/chat/completions

# OPENAI_MODELS=gpt-3.5-turbo,gpt-3.5-turbo-16k,gpt-3.5-turbo-0301,text-davinci-003,gpt-4,gpt-4-0314,gpt-4-0613

Note: The OPENAI_MODELS variable is commented out so that the server can fetch nagaai/api/v1/models for all available models. Uncomment and adjust if you wish to specify which exact models you want to use.

It's worth noting that not all models listed by their API will work, with or without this project. The exact URL may also change, just make sure you include /v1/chat/completions in the reverse proxy URL if it ever changes.

You can set OPENAI_API_KEY=user_provided if you would like the user to add their own NagaAI API key, just be sure you specify the models with OPENAI_MODELS in this case since they won't be able to be fetched without an admin set API key.

That's it! You're all set. 🎉

Here's me using Llama2 via NagaAI

Screenshot 2023-07-23 201709

Plugins also work with this reverse proxy (OpenAI models). More info on plugins here

Screenshot 2023-07-23 202426

⚠️ Note: If you're having trouble, before creating a new issue, please search for similar ones on our #issues thread on our discord or our troubleshooting discussion on our Discussions page. If you don't find a relevant issue, feel free to create a new one and provide as much detail as possible.