Unable to install beir

[thatcort]

When I try to install beir I get an error message from installing pytrec-eval (0.5):

root@e1b5df4b3b9f:/app# poetry add beir==2.0.0

Updating dependencies
Resolving dependencies... (13.6s)

Package operations: 4 installs, 0 updates, 0 removals

  - Installing elasticsearch (7.9.1)
  - Installing faiss-cpu (1.8.0): Installing...
  - Installing pytrec-eval (0.5): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel
  
  /tmp/tmp_0hfdrb4/.venv/lib/python3.10/site-packages/setuptools/dist.py:476: SetuptoolsDeprecationWarning: Invalid dash-separated options
  !!
  
          ********************************************************************************
          Usage of dash-separated 'description-file' will not be supported in future
          versions. Please use the underscore name 'description_file' instead.
  
          By 2024-Sep-26, you need to update your project and remove deprecated calls
          or your builds will no longer be supported.
  
          See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
          ********************************************************************************
  
  !!
    opt = self.warn_dash_deprecation(opt, section)
  Fetching trec_eval from https://github.com/usnistgov/trec_eval/archive/v9.0.8.tar.gz.
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-cpython-310
  creating build/lib.linux-x86_64-cpython-310/pytrec_eval
  copying py/__init__.py -> build/lib.linux-x86_64-cpython-310/pytrec_eval
  running build_ext
  building 'pytrec_eval_ext' extension
  creating build/temp.linux-x86_64-cpython-310
  creating build/temp.linux-x86_64-cpython-310/tmp
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8
  creating build/temp.linux-x86_64-cpython-310/src
  x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSIONID=\"pytrec_eval\" -D_GLIBCXX_USE_CXX11_ABI=0 -DP_NEEDS_GNU_CXX_NAMESPACE=1 -UNDEBUG -I/tmp/tmppumjh7ob/trec_eval-9.0.8 -I/tmp/tmp_0hfdrb4/.venv/include -I/usr/include/python3.10 -c /tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.c -o build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.o -g -Wall -O3
  - Installing pytrec-eval (0.5): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel
  
  /tmp/tmp_0hfdrb4/.venv/lib/python3.10/site-packages/setuptools/dist.py:476: SetuptoolsDeprecationWarning: Invalid dash-separated options
  !!
  
          ********************************************************************************
          Usage of dash-separated 'description-file' will not be supported in future
          versions. Please use the underscore name 'description_file' instead.
  
          By 2024-Sep-26, you need to update your project and remove deprecated calls
          or your builds will no longer be supported.
  
          See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
          ********************************************************************************
  
  !!
    opt = self.warn_dash_deprecation(opt, section)
  Fetching trec_eval from https://github.com/usnistgov/trec_eval/archive/v9.0.8.tar.gz.
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-cpython-310
  creating build/lib.linux-x86_64-cpython-310/pytrec_eval
  copying py/__init__.py -> build/lib.linux-x86_64-cpython-310/pytrec_eval
  running build_ext
  building 'pytrec_eval_ext' extension
  creating build/temp.linux-x86_64-cpython-310
  creating build/temp.linux-x86_64-cpython-310/tmp
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8
  creating build/temp.linux-x86_64-cpython-310/src
  x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSIONID=\"pytrec_eval\" -D_GLIBCXX_USE_CXX11_ABI=0 -DP_NEEDS_GNU_CXX_NAMESPACE=1 -UNDEBUG -I/tmp/tmppumjh7ob/trec_eval-9.0.8 -I/tmp/tmp_0hfdrb4/.venv/include -I/usr/include/python3.10 -c /tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.c -o build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.o -g -Wall -O3
  - Installing faiss-cpu (1.8.0)
  - Installing pytrec-eval (0.5): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel
  
  /tmp/tmp_0hfdrb4/.venv/lib/python3.10/site-packages/setuptools/dist.py:476: SetuptoolsDeprecationWarning: Invalid dash-separated options
  !!
  
          ********************************************************************************
          Usage of dash-separated 'description-file' will not be supported in future
          versions. Please use the underscore name 'description_file' instead.
  
          By 2024-Sep-26, you need to update your project and remove deprecated calls
          or your builds will no longer be supported.
  
          See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
          ********************************************************************************
  
  !!
    opt = self.warn_dash_deprecation(opt, section)
  Fetching trec_eval from https://github.com/usnistgov/trec_eval/archive/v9.0.8.tar.gz.
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-cpython-310
  creating build/lib.linux-x86_64-cpython-310/pytrec_eval
  copying py/__init__.py -> build/lib.linux-x86_64-cpython-310/pytrec_eval
  running build_ext
  building 'pytrec_eval_ext' extension
  creating build/temp.linux-x86_64-cpython-310
  creating build/temp.linux-x86_64-cpython-310/tmp
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob
  creating build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8
  creating build/temp.linux-x86_64-cpython-310/src
  x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -fPIC -DVERSIONID=\"pytrec_eval\" -D_GLIBCXX_USE_CXX11_ABI=0 -DP_NEEDS_GNU_CXX_NAMESPACE=1 -UNDEBUG -I/tmp/tmppumjh7ob/trec_eval-9.0.8 -I/tmp/tmp_0hfdrb4/.venv/include -I/usr/include/python3.10 -c /tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.c -o build/temp.linux-x86_64-cpython-310/tmp/tmppumjh7ob/trec_eval-9.0.8/convert_zscores.o -g -Wall -O3
  error: command 'x86_64-linux-gnu-gcc' failed: No such file or directory
  

  at /opt/poetry-venv/lib/python3.10/site-packages/poetry/installation/chef.py:164 in _prepare
      160│ 
      161│                 error = ChefBuildError("\n\n".join(message_parts))
      162│ 
      163│             if error is not None:
    → 164│                 raise error from None
      165│ 
      166│             return path
      167│ 
      168│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with pytrec-eval (0.5) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "pytrec-eval (==0.5)"'.

How can I handle this?

[clintonroy]

For this error:

  error: command 'x86_64-linux-gnu-gcc' failed: No such file or directory

Install a compiler.

Bigger picture, use packages with pre build wheels.

[thatcort]

Thank you! Was able to get it to install by installing build-essential and python3-dev.