Build fails due to pandas version constraint and the installed python version mismatch (CON-1499)

[cameloper]

Describe the bug
install.sh script fails with subprocess-exited-with-error during the installation of pip requirements. The meson build of pandas stops with exit code 1 because the used python version (3.13) is not supported by the constrained pandas version (2.1.4). It is also possible that there's another version mismatch with some other dependency, but Python 3.13 is definitely not listed on the official pandas documentation.

Environment

• ESP-Matter Commit Id: 96b0939

• ESP-IDF Commit Id: 67c1de1

• Host Machine OS: Arch 6.12.8-arch1-1

• Host Machine Python version: 3.13.1-1

Any additional details
Here's part of the terminal logs;

Installing pip requirements for all...
  error: subprocess-exited-with-error
  
  × Preparing metadata (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [124 lines of output]
      + meson setup /tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10 /tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10/.mesonpy-8_jg9maz/build -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --vsenv --native-file=/tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10/.mesonpy-8_jg9maz/build/meson-python-native-file.ini
The Meson build system
      Version: 1.2.1
      Source dir: /tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10
      Build dir: /tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10/.mesonpy-8_jg9maz/build
      Build type: native build
      Project name: pandas
      Project version: 2.1.4
      C compiler for the host machine: ccache cc (gcc 14.2.1 "cc (GCC) 14.2.1 20240910")
      C linker for the host machine: cc ld.bfd 2.43.0
      C++ compiler for the host machine: ccache c++ (gcc 14.2.1 "c++ (GCC) 14.2.1 20240910")
      C++ linker for the host machine: c++ ld.bfd 2.43.0
      Cython compiler for the host machine: cython (cython 0.29.37)
      Host machine cpu family: x86_64
      Host machine cpu: x86_64
      Program python found: YES (/home/cameloper/dev/esp/esp-matter/connectedhomeip/connectedhomeip/.environment/pigweed-venv/bin/python)
      Found pkg-config: /sbin/pkg-config (2.3.0)
      Run-time dependency python found: YES 3.13
      Build targets in project: 53
      
      pandas 2.1.4
      
        User defined options
          Native files: /tmp/pip-install-vhm9vqf6/pandas_5720f716595c4b569756abbc93e22e10/.mesonpy-8_jg9maz/build/meson-python-native-file.ini
          buildtype   : release
          vsenv       : True
          b_ndebug    : if-release
          b_vscrt     : md
      
      Found ninja-1.13.0.git.fuchsia at /home/cameloper/dev/esp/esp-matter/connectedhomeip/connectedhomeip/.environment/cipd/packages/pigweed/bin/ninja      
      Visual Studio environment is needed to run Ninja. It is recommended to use Meson wrapper:
      /tmp/pip-build-env-ou2mtpk4/overlay/bin/meson compile -C .
      + /home/cameloper/dev/esp/esp-matter/connectedhomeip/connectedhomeip/.environment/cipd/packages/pigweed/bin/ninja

                ... // Here's a long python build error stack

      ninja: build stopped: subcommand failed.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

[notice] A new release of pip is available: 23.2.1 -> 24.3.1
[notice] To update, run: pip install --upgrade pip

[shubhamdp]

@cameloper Thanks for reporting, as far as building the esp-matter/examples goes, you can still build the examples...

cd examples/light
idf.py build

I was unable to re-produce this on the ubuntu 22.04 and macos, and will need some time to support it on Arch...