Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dagster-pipeline CI Docker build: investigate why the fiona wheel isn't being used #8

Open
derhuerst opened this issue Sep 11, 2023 · 2 comments
Labels
wontfix This will not be worked on

Comments

@derhuerst
Copy link
Member

derhuerst commented Sep 11, 2023

In the CI pipeline.Dockerfile build, the fiona wheel isn't downloaded but built "manually", causing ~10m of CI run time.

Probably the arm64 build needs to build it from scratch, whereas amd64 downloads a prebuilt binary?

This came up in #1.

@hbruch
Copy link
Collaborator

hbruch commented Nov 12, 2023

To me, it looks like there is no prebuilt linux/arm64 wheel available via PyPi, only macosx_11_0_arm64.whl.

https://github.com/sgillies/fiona-wheels says

Other platforms are out of scope at this time.

The suggestion "you may find them [...], or in Docker images published by the GDAL project." on that site seems to be not an option neither, as gdal images seem to be updated only infrequently.

On anaconda, Fiona images are somewhat outdated also (v.1.9.1 (seven months old) vs 1.9.5 on PyPi).

For amd64, the pre-built wheel is downloaded:

Downloading Fiona-1.9.4.post1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.4 MB)

@derhuerst derhuerst added the wontfix This will not be worked on label Nov 29, 2023
@derhuerst
Copy link
Member Author

This is out-of-scope for now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
wontfix This will not be worked on
Projects
None yet
Development

No branches or pull requests

2 participants