python --version
Python 3.12.3
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
- Sign up on hugging face and get token https://huggingface.co/docs/hub/en/security-tokens
- Export
cp .env.template .env
# add your token to .env
source .env
python chat.py
You can change the model by changing the repo_id parameter