Podman user gets gcl-cmd: applet not found error

[elafontaine]

Minimal .gitlab-ci.yml illustrating the issue

---
myjob:
  stage: check
  image:
    name: mysteriouscode/cfn-lint:latest
    entrypoint: [""]
  script:
    - cfn-lint CloudFormation.yml

Expected behavior
Same behaviour as docker users, but I'm unsure why it's different on podman yet...

Host information
MacOS podman
gitlab-ci-local 4.55.0

Containerd binary
podman

Additional context
We run the jobs with docker most of the team, but the license cost is starting to be a concern. Some people were already using podman, but were unable to get the same jobs as us to run. You have a snippet of the code that fails. The error message seems to be caused by this line ; https://github.com/firecow/gitlab-ci-local/blob/4.55.0/src/job.ts#L872C143-L872C151
This is the only place where I found "gcl-cmd".

I will try to dig out more details.

[elafontaine]

I think it's because the base image is a busybox and that the "cmd" doesn't have a #! for busybox to interpret the script correctly. Still have to figure out how come it works on docker though...
https://github.com/firecow/gitlab-ci-local/blob/4.55.0/src/job.ts#L847C1-L847C40

[elafontaine]

Is there a way to leave the container in place on failure ? I would like to explore the filesystem to figure it out...

[firecow]

@elafontaine Does this work on gitlab.com?

[ANGkeith]

cat > foo <<EOF
echo 1
EOF
chmod +x foo

cat > Dockerfile <<EOF
FROM alpine        #  or mysteriouscode/cfn-lint:latest
COPY foo foo
RUN /foo
EOF

docker build . --platform linux/amd64 works but podman build . --platform linux/amd64

seemed to be some issue with podman but not sure exactly why tho

---

replicable on apple silicon mac.

have not tested on linux/ intelnmac

[firecow]

Does this work on a gitlab instance using where the runner is using podman?

[elafontaine]

Sorry for the delay in response, I was out of commission.

@firecow, for your question on if this is gitlab.com; yes, this is on gitlab.com. Same as for the other tickets I'm opening.
For you question on if we have runners that use podman, I don't have such runner unfortunately. Team members are trying to avoid the docker desktop license and that's why they have issues. I'm unsure of why this happens though... the only problem I could see is the volume mapping...

@ANGkeith Thanks for testing this out :D I've been running out of time to do everything I need to get to.

[firecow]

Ok, we will try to fix. Just wanted to know, if you have seen a podman gitlab-runner perform these tasks for us to better debug.