Running "poetry run python scripts/setup 401" "Client Error: Unauthorized for url"

[mainframecn]

Hello,

I've been following the installation instructions and came to the point where I can download models through the setup script. Running the "poetry run python scripts/setup" results in some errors. It would see it is trying to access a private resource on huggingface, although i'm not sure that is the main issue.

poetry run python scripts/setup
11:56:44.921 [INFO    ] private_gpt.settings.settings_loader - Starting application with profiles=['default']
Downloading embedding BAAI/bge-small-en-v1.5
Fetching 14 files: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 14/14 [00:00<00:00, 62.88it/s]Embedding model downloaded!
Downloading LLM mistral-7b-instruct-v0.2.Q4_K_M.gguf
LLM model downloaded!
Downloading tokenizer None
model-name: None
cache dir:  /home/privateGPT/models/cache
Traceback (most recent call last):
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py", line 270, in hf_raise_for_status
    response.raise_for_status()
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://huggingface.co/None/resolve/main/tokenizer_config.json

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/transformers/utils/hub.py", line 398, in cached_file
    resolved_file = hf_hub_download(
                    ^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1374, in hf_hub_download
    raise head_call_error
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1247, in hf_hub_download
    metadata = get_hf_file_metadata(
               ^^^^^^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/utils/_validators.py", line 118, in _inner_fn
    return fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 1624, in get_hf_file_metadata
    r = _request_wrapper(
        ^^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 402, in _request_wrapper
    response = _request_wrapper(
               ^^^^^^^^^^^^^^^^^
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/file_download.py", line 426, in _request_wrapper
    hf_raise_for_status(response)
  File "/home/mainframe/.cache/pypoetry/virtualenvs/private-gpt-jSGsLBP4-py3.11/lib/python3.11/site-packages/huggingface_hub/utils/_errors.py", line 320, in hf_raise_for_status
    raise RepositoryNotFoundError(message, response) from e
huggingface_hub.utils._errors.RepositoryNotFoundError: 401 Client Error. (Request ID: Root=1-65f1866e-287b20bf4c800f1e28553664;a14679bb-a79e-4d4b-8686-508d13f5996f)

Repository Not Found for url: https://huggingface.co/None/resolve/main/tokenizer_config.json.
Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated.
Invalid username or password.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

[Cassioneto]

do in cli:
$poetry shell
$huggingface-cli login
$exit

[BradHutchings]

You need to create an account on Huggingface.co, create a token on Huggingface, and request access to whichever repo it's complaining about. If you're building for local, this will be the Meta / LLama (rough name) repo. You'll have to go there and request access, which is usually granted within a few hours.

Next, see my not in discussion about adding HF_TOKEN to settings-local.yaml.

Finally, you need to set HF_TOKEN in the shell, e.g.:
export HF_TOKEN="hf_YOUR_TOKEN_HERE"

Hope that helps!

-Brad