New s5cmd Python package for distributing the corresponding go executable

[jcfr]

The GitHub project jcfr/s5cmd-python-distributions provides the infrastructure to build, test and publish s5cmd Python wheels.

It relies on the scikit-build-core build backend along with a simple CMake based project for downloading the official executable from the corresponding GitHub Release published in the upstream project. Relevant URLs and associated checksums are listed in the s5cmdUrls.cmake¹ module.

Initially generated using the scientific-python/cookie² template, the CI and CD GitHub workflows have been augmented³ to use QEMU⁴ for also building and testing the Linux platforms arm64 and ppc64le.

The following platforms are supported by the binary wheels:

OS	Arch
Windows	64-bit 32-bit ARM64
Linux Intel	manylinux 64-bit musllinux 64-bit manylinux 32-bit musllinux 32-bit
Linux ARM	manylinux AArch64 musllinux AArch64
Linux PowerPC	manylinux ppc64le musllinux ppc64le
macOS 10.10+	Intel
macOS 11+	Apple Silicon

References:

• Facilitating Python Usage: Proposal for s5cmd Wheels peak/s5cmd#703
• feat: Simplify build-system by transitioning to pure Python wheel ImagingDataCommons/idc-index#48

Footnotes

1. https://github.com/jcfr/s5cmd-python-distributions/blob/0.1.0/s5cmdUrls.cmake ↩

2. https://github.com/scientific-python/cookie ↩

3. Approach adapted from prior work done in https://github.com/scikit-build/cmake-python-distributions ↩

4. https://cibuildwheel.readthedocs.io/en/stable/faq/#emulation ↩