Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

startup fail- Control socket connect #1165

Open
1 of 5 tasks
bodsch opened this issue Oct 16, 2024 · 7 comments
Open
1 of 5 tasks

startup fail- Control socket connect #1165

bodsch opened this issue Oct 16, 2024 · 7 comments

Comments

@bodsch
Copy link

bodsch commented Oct 16, 2024

Description

Fresh install of colima for local testing.

$ colima start
INFO[0000] starting colima                              
INFO[0000] runtime: docker                              
INFO[0000] creating and starting ...                     context=vm
> "[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 39849 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
> [hostagent] Shutting down QEMU with ACPI
> [hostagent] Failed to remove SSH binding for port 39849
> "[hostagent] failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused"
> [hostagent] QEMU has already exited
> exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/home/bodsch/.config/colima/_lima/colima/ha.stderr.log")
FATA[0000] error starting vm: error at 'creating and starting': exit status 1

Version

  • colima version v0.7.5 - git commit: 1588c06
  • limactl version 0.23.2
  • qemu-img version 9.1.0

Operating System

  • macOS Intel <= 13 (Ventura)
  • macOS Intel >= 14 (Sonoma)
  • Apple Silicon <= 13 (Ventura)
  • Apple Silicon >= 14 (Sonoma)
  • Linux

Output of colima status

colima status
FATA[0000] colima is not running

Reproduction Steps

  1. install both packes direct from github and extract to /usr/local
  2. colima start
  3. fail

Expected behaviour

No response

Additional context

ha.stdout.log

{"time":"2024-10-16T14:14:31.682147467+02:00","status":{"sshLocalPort":39849}}
{"time":"2024-10-16T14:14:31.853121283+02:00","status":{"exiting":true}}

ha.stderr.log

{"level":"debug","msg":"Creating iso file /home/bodsch/.config/colima/_lima/colima/cidata.iso","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso1085749784 as workspace","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"OpenSSH version 9.9.1 detected","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"hostagent socket created at /home/bodsch/.config/colima/_lima/colima/ha.sock","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"QEMU version 9.1.0 detected","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"firmware candidates = [/home/bodsch/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/OVMF/OVMF_CODE_4M.fd /usr/share/edk2/ovmf/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Using system firmware (\"/usr/share/edk2-ovmf/x64/OVMF_CODE.fd\")","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/home/bodsch/.config/colima/_lima/colima/serial*.log\")","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"qCmd.Args: [/usr/bin/qemu-system-x86_64 -m 2048 -cpu host -machine q35,accel=kvm -smp 2,sockets=1,cores=2,threads=1 -drive if=pflash,format=raw,readonly=on,file=/usr/share/edk2-ovmf/x64/OVMF_CODE.fd -boot order=c,splash-time=0,menu=on -drive file=/home/bodsch/.config/colima/_lima/colima/diffdisk,if=virtio,discard=on -drive id=cdrom0,if=none,format=raw,readonly=on,file=/home/bodsch/.config/colima/_lima/colima/cidata.iso -device virtio-scsi-pci,id=scsi0 -device scsi-cd,bus=scsi0.0,drive=cdrom0 -netdev socket,id=net0,fd=3 -device virtio-net-pci,netdev=net0,mac=52:55:55:a6:3f:36 -device virtio-rng-pci -display none -device virtio-vga -device virtio-keyboard-pci -device virtio-mouse-pci -device qemu-xhci,id=usb-bus -parallel none -chardev socket,id=char-serial,path=/home/bodsch/.config/colima/_lima/colima/serial.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serial.log -serial chardev:char-serial -chardev socket,id=char-serial-virtio,path=/home/bodsch/.config/colima/_lima/colima/serialv.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serialv.log -device virtio-serial-pci,id=virtio-serial0,max_ports=1 -device virtconsole,chardev=char-serial-virtio,id=console0 -chardev socket,id=char-qmp,path=/home/bodsch/.config/colima/_lima/colima/qmp.sock,server=on,wait=off -qmp chardev:char-qmp -chardev socket,path=/home/bodsch/.config/colima/_lima/colima/ga.sock,server=on,wait=off,id=qga0 -device virtio-serial -device virtserialport,chardev=qga0,name=io.lima-vm.guest_agent.0 -name lima-colima -pidfile /home/bodsch/.config/colima/_lima/colima/qemu.pid]","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 4: \"ssh\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -p 39849 127.0.0.1 -- /bin/bash]","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 39849: Connection refused\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 39849: Connection refused\\r\\n\": exit status 255","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"qemu[stderr]: qemu-system-x86_64: -device virtio-vga: 'virtio-vga' is not a valid device model name","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Driver stopped due to error: \"exit status 1\"","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2024-10-16T14:14:31+02:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -O exit -p 39849 127.0.0.1]","time":"2024-10-16T14:14:31+02:00"}
{"error":"failed to execute `ssh -O exit -p 39849 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"Shutting down QEMU with ACPI","time":"2024-10-16T14:14:31+02:00"}
{"level":"warning","msg":"Failed to remove SSH binding for port 39849","time":"2024-10-16T14:14:31+02:00"}
{"error":"dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused","level":"warning","msg":"failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU","time":"2024-10-16T14:14:31+02:00"}
{"level":"info","msg":"QEMU has already exited","time":"2024-10-16T14:14:31+02:00"}
@michielsarne2
Copy link

Same on mac here

@bodsch bodsch changed the title startup fail startup fail- Control socket connect Oct 16, 2024
@jeremiah
Copy link

This is a known bug. The solution that worked for me when I encountered the same problem on my M1 is listed here: #381 towards the end.

TLDR;

  1. Remove the folder ~/.colima/_lima/_networks
  2. Restart colima

@bodsch
Copy link
Author

bodsch commented Oct 23, 2024

No, that doesn't work for me. :(

$ rm -rfv ~/.colima/_lima/_networks
$ colima start
INFO[0000] starting colima                              
INFO[0000] runtime: docker                              
INFO[0000] creating and starting ...                     context=vm
INFO[0000] downloading disk image ...                    context=vm
> "[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 40597 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
> [hostagent] Shutting down QEMU with ACPI
> [hostagent] Failed to remove SSH binding for port 40597
> "[hostagent] failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused"
> [hostagent] QEMU has already exited
> exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see "/home/bodsch/.config/colima/_lima/colima/ha.stderr.log")
FATA[0037] error starting vm: error at 'creating and starting': exit status 1
$ cat /home/bodsch/.config/colima/_lima/colima/ha.stderr.log
{"level":"debug","msg":"executing [ssh-keygen -t ed25519 -q -N  -C lima -f /home/bodsch/.config/colima/_lima/_config/user]","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"Creating iso file /home/bodsch/.config/colima/_lima/colima/cidata.iso","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"Using /tmp/diskfs_iso4268600307 as workspace","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"OpenSSH version 9.9.1 detected","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"AES accelerator seems available, prioritizing aes128-gcm@openssh.com and aes256-gcm@openssh.com","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"hostagent socket created at /home/bodsch/.config/colima/_lima/colima/ha.sock","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"QEMU version 9.1.1 detected","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"firmware candidates = [/home/bodsch/.local/share/qemu/edk2-x86_64-code.fd /usr/share/qemu/edk2-x86_64-code.fd /usr/share/OVMF/OVMF_CODE.fd /usr/share/OVMF/OVMF_CODE_4M.fd /usr/share/edk2/ovmf/OVMF_CODE.fd /usr/share/qemu/ovmf-x86_64-code.bin /usr/share/edk2-ovmf/x64/OVMF_CODE.fd]","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Using system firmware (\"/usr/share/edk2-ovmf/x64/OVMF_CODE.fd\")","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Starting QEMU (hint: to watch the boot progress, see \"/home/bodsch/.config/colima/_lima/colima/serial*.log\")","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"qCmd.Args: [/usr/bin/qemu-system-x86_64 -m 2048 -cpu host -machine q35,accel=kvm -smp 2,sockets=1,cores=2,threads=1 -drive if=pflash,format=raw,readonly=on,file=/usr/share/edk2-ovmf/x64/OVMF_CODE.fd -boot order=c,splash-time=0,menu=on -drive file=/home/bodsch/.config/colima/_lima/colima/diffdisk,if=virtio,discard=on -drive id=cdrom0,if=none,format=raw,readonly=on,file=/home/bodsch/.config/colima/_lima/colima/cidata.iso -device virtio-scsi-pci,id=scsi0 -device scsi-cd,bus=scsi0.0,drive=cdrom0 -netdev socket,id=net0,fd=3 -device virtio-net-pci,netdev=net0,mac=52:55:55:a6:3f:36 -device virtio-rng-pci -display none -device virtio-vga -device virtio-keyboard-pci -device virtio-mouse-pci -device qemu-xhci,id=usb-bus -parallel none -chardev socket,id=char-serial,path=/home/bodsch/.config/colima/_lima/colima/serial.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serial.log -serial chardev:char-serial -chardev socket,id=char-serial-virtio,path=/home/bodsch/.config/colima/_lima/colima/serialv.sock,server=on,wait=off,logfile=/home/bodsch/.config/colima/_lima/colima/serialv.log -device virtio-serial-pci,id=virtio-serial0,max_ports=1 -device virtconsole,chardev=char-serial-virtio,id=console0 -chardev socket,id=char-qmp,path=/home/bodsch/.config/colima/_lima/colima/qmp.sock,server=on,wait=off -qmp chardev:char-qmp -chardev socket,path=/home/bodsch/.config/colima/_lima/colima/ga.sock,server=on,wait=off,id=qga0 -device virtio-serial -device virtserialport,chardev=qga0,name=io.lima-vm.guest_agent.0 -name lima-colima -pidfile /home/bodsch/.config/colima/_lima/colima/qemu.pid]","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Waiting for the essential requirement 1 of 4: \"ssh\"","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"executing script \"ssh\"","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"executing ssh for script \"ssh\": /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -p 40597 127.0.0.1 -- /bin/bash]","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 40597: Connection refused\\r\\n\", err=failed to execute script \"ssh\": stdout=\"\", stderr=\"ssh: connect to host 127.0.0.1 port 40597: Connection refused\\r\\n\": exit status 255","time":"2024-10-23T08:02:19+02:00"}
{"level":"debug","msg":"qemu[stderr]: qemu-system-x86_64: -device virtio-vga: 'virtio-vga' is not a valid device model name","time":"2024-10-23T08:02:19+02:00"}
{"level":"info","msg":"Driver stopped due to error: \"exit status 1\"","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"Shutting down the host agent","time":"2024-10-23T08:02:20+02:00"}
{"level":"debug","msg":"shutting down the SSH master","time":"2024-10-23T08:02:20+02:00"}
{"level":"debug","msg":"executing ssh for exiting the master: /usr/bin/ssh [ssh -F /dev/null -o IdentityFile=\"/home/bodsch/.config/colima/_lima/_config/user\" -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -o NoHostAuthenticationForLocalhost=yes -o GSSAPIAuthentication=no -o PreferredAuthentications=publickey -o Compression=no -o BatchMode=yes -o IdentitiesOnly=yes -o Ciphers=\"^aes128-gcm@openssh.com,aes256-gcm@openssh.com\" -o User=bodsch -o ControlMaster=auto -o ControlPath=\"/home/bodsch/.config/colima/_lima/colima/ssh.sock\" -o ControlPersist=yes -O exit -p 40597 127.0.0.1]","time":"2024-10-23T08:02:20+02:00"}
{"error":"failed to execute `ssh -O exit -p 40597 127.0.0.1`, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"Shutting down QEMU with ACPI","time":"2024-10-23T08:02:20+02:00"}
{"level":"warning","msg":"Failed to remove SSH binding for port 40597","time":"2024-10-23T08:02:20+02:00"}
{"error":"dial unix /home/bodsch/.config/colima/_lima/colima/qmp.sock: connect: connection refused","level":"warning","msg":"failed to open the QMP socket \"/home/bodsch/.config/colima/_lima/colima/qmp.sock\", forcibly killing QEMU","time":"2024-10-23T08:02:20+02:00"}
{"level":"info","msg":"QEMU has already exited","time":"2024-10-23T08:02:20+02:00"}

@jeremiah
Copy link

I think the main issue is here;
"error":"failed to execute ssh -O exit -p 40597 127.0.0.1, out=\"Control socket connect(/home/bodsch/.config/colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255","level":"warning","msg":"failed to exit SSH master","time":"2024-10-23T08:02:20+02:00"}

I will rerun the same commands on my machine and try to see if I can replicate your issue.

@bodsch
Copy link
Author

bodsch commented Oct 24, 2024

Perhaps some important information about my system:

  • OS: ArchLinux (daily updated)
  • QEMU: 9.1.1
  • libvirt: 10.8.0

libvirtd Service are running (maybe a problem?)

@abiosoft
Copy link
Owner

Oh, just realising you are running Linux.

I would need to be able to reproduce this. I only have access to Linux aarch64, so the experience may vary.

@zackees
Copy link

zackees commented Oct 31, 2024

Hitting this on a github runner for mac arm. It looks like QEMU is crashing. I saw somewhere else that I have to downgrade to 9.0.2, as there is a bug in 9.1.0, if memory serves correct. I'm going to try that next.

Output log

Run bash install
  
==> Downloading https://ghcr.io/v2/homebrew/core/uv/manifests/0.4.25
==> Fetching uv
==> Downloading https://ghcr.io/v2/homebrew/core/uv/blobs/sha256:2d7e252c755fb313c4d7cdc7cd25ae5270062[14](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:14)0195ad26e0ca326de04a4ab47
==> Pouring uv--0.4.25.arm64_sonoma.bottle.tar.gz
==> Caveats
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
==> Summary
🍺  /opt/homebrew/Cellar/uv/0.4.25: 17 files, 25.9MB
Using CPython 3.11.9 interpreter at: /Library/Frameworks/Python.framework/Versions/3.11/bin/python
Creating virtual environment with seed packages at: .venv
 + pip==24.3.1
 + setuptools==75.3.0
 + wheel==0.44.0
Activate with: source .venv/bin/activate
Installed 20 packages in 9ms
Obtaining file:///Users/runner/work/fastled-wasm/fastled-wasm
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Checking if build backend supports build_editable: started
  Checking if build backend supports build_editable: finished with status 'done'
  Getting requirements to build editable: started
  Getting requirements to build editable: finished with status 'done'
  Preparing editable metadata (pyproject.toml): started
  Preparing editable metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: docker in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (6.1.3)
Requirement already satisfied: keyring in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (24.1.1)
Requirement already satisfied: watchdog in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (3.0.0)
Requirement already satisfied: livereload in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (2.7.0)
Requirement already satisfied: download in ./.venv/lib/python3.11/site-packages (from fastled_wasm==1.0.6) (0.3.5)
Requirement already satisfied: packaging>=[14](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:15).0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (24.0)
Requirement already satisfied: requests>=2.26.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (2.31.0)
Requirement already satisfied: urllib3>=1.26.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (2.0.7)
Requirement already satisfied: websocket-client>=0.32.0 in ./.venv/lib/python3.11/site-packages (from docker->fastled_wasm==1.0.6) (1.6.1)
Requirement already satisfied: tqdm in ./.venv/lib/python3.11/site-packages (from download->fastled_wasm==1.0.6) (4.66.6)
Requirement already satisfied: six in ./.venv/lib/python3.11/site-packages (from download->fastled_wasm==1.0.6) (1.16.0)
Requirement already satisfied: jaraco.classes in ./.venv/lib/python3.11/site-packages (from keyring->fastled_wasm==1.0.6) (3.2.3)
Requirement already satisfied: importlib-metadata>=4.11.4 in ./.venv/lib/python3.11/site-packages (from keyring->fastled_wasm==1.0.6) (6.7.0)
Requirement already satisfied: tornado in ./.venv/lib/python3.11/site-packages (from livereload->fastled_wasm==1.0.6) (6.2)
Requirement already satisfied: zipp>=0.5 in ./.venv/lib/python3.11/site-packages (from importlib-metadata>=4.11.4->keyring->fastled_wasm==1.0.6) (3.[15](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:16).0)
Requirement already satisfied: charset-normalizer<4,>=2 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (3.4.0)
Requirement already satisfied: idna<4,>=2.5 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in ./.venv/lib/python3.11/site-packages (from requests>=2.26.0->docker->fastled_wasm==1.0.6) (2024.8.30)
Requirement already satisfied: more-itertools in ./.venv/lib/python3.11/site-packages (from jaraco.classes->keyring->fastled_wasm==1.0.6) (9.1.0)
Building wheels for collected packages: fastled_wasm
  Building editable for fastled_wasm (pyproject.toml): started
  Building editable for fastled_wasm (pyproject.toml): finished with status 'done'
  Created wheel for fastled_wasm: filename=fastled_wasm-1.0.6-0.editable-py3-none-any.whl size=3662 sha256=1145de0c22b7f30e3eacd47610b74bea7abf4c1e08ce1bdc1bd76f9b3875374e
  Stored in directory: /private/var/folders/g6/rgtlsw6n123b0gt5483s5_cm0000gn/T/pip-ephem-wheel-cache-w8z7qn2u/wheels/86/6f/e9/b3f17154fd3179462b93214cf32994ec69b7663310e3b5228c
Successfully built fastled_wasm
Installing collected packages: fastled_wasm
  Attempting uninstall: fastled_wasm
    Found existing installation: fastled_wasm 1.0.6
    Uninstalling fastled_wasm-1.0.6:
      Successfully uninstalled fastled_wasm-1.0.6
Successfully installed fastled_wasm-1.0.6
Uninstalled 1 package in 0.57ms
Installed 1 package in 2ms
Collecting black (from -r requirements.testing.txt (line 1))
  Downloading black-24.10.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (79 kB)
Collecting isort (from -r requirements.testing.txt (line 2))
  Downloading isort-5.13.2-py3-none-any.whl.metadata (12 kB)
Collecting mypy (from -r requirements.testing.txt (line 3))
  Downloading mypy-1.13.0-cp311-cp311-macosx_11_0_arm64.whl.metadata (2.1 kB)
Collecting pytest (from -r requirements.testing.txt (line 4))
  Downloading pytest-8.3.3-py3-none-any.whl.metadata (7.5 kB)
Collecting ruff (from -r requirements.testing.txt (line 5))
  Downloading ruff-0.7.1-py3-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting pytest-xdist (from -r requirements.testing.txt (line 6))
  Downloading pytest_xdist-3.6.1-py3-none-any.whl.metadata (4.3 kB)
Collecting click>=8.0.0 (from black->-r requirements.testing.txt (line 1))
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting mypy-extensions>=0.4.3 (from black->-r requirements.testing.txt (line 1))
  Downloading mypy_extensions-1.0.0-py3-none-any.whl.metadata (1.1 kB)
Requirement already satisfied: packaging>=22.0 in ./.venv/lib/python3.11/site-packages (from black->-r requirements.testing.txt (line 1)) (24.0)
Collecting pathspec>=0.9.0 (from black->-r requirements.testing.txt (line 1))
  Downloading pathspec-0.12.1-py3-none-any.whl.metadata (21 kB)
Collecting platformdirs>=2 (from black->-r requirements.testing.txt (line 1))
  Downloading platformdirs-4.3.6-py3-none-any.whl.metadata (11 kB)
Collecting typing-extensions>=4.6.0 (from mypy->-r requirements.testing.txt (line 3))
  Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting iniconfig (from pytest->-r requirements.testing.txt (line 4))
  Downloading iniconfig-2.0.0-py3-none-any.whl.metadata (2.6 kB)
Collecting pluggy<2,>=1.5 (from pytest->-r requirements.testing.txt (line 4))
  Downloading pluggy-1.5.0-py3-none-any.whl.metadata (4.8 kB)
Collecting execnet>=2.1 (from pytest-xdist->-r requirements.testing.txt (line 6))
  Downloading execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
Downloading black-24.10.0-cp311-cp311-macosx_11_0_arm64.whl (1.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 41.3 MB/s eta 0:00:00
Downloading isort-5.13.2-py3-none-any.whl (92 kB)
Downloading mypy-1.13.0-cp311-cp311-macosx_11_0_arm64.whl (10.1 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.1/10.1 MB 87.7 MB/s eta 0:00:00
Downloading pytest-8.3.3-py3-none-any.whl (342 kB)
Downloading ruff-0.7.1-py3-none-macosx_11_0_arm64.whl (9.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 9.8/9.8 MB 124.8 MB/s eta 0:00:00
Downloading pytest_xdist-3.6.1-py3-none-any.whl (46 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
Downloading execnet-2.1.1-py3-none-any.whl (40 kB)
Downloading mypy_extensions-1.0.0-py3-none-any.whl (4.7 kB)
Downloading pathspec-0.12.1-py3-none-any.whl (31 kB)
Downloading platformdirs-4.3.6-py3-none-any.whl (18 kB)
Downloading pluggy-1.5.0-py3-none-any.whl (20 kB)
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Downloading iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Installing collected packages: typing-extensions, ruff, pluggy, platformdirs, pathspec, mypy-extensions, isort, iniconfig, execnet, click, pytest, mypy, black, pytest-xdist
Successfully installed black-24.10.0 click-8.1.7 execnet-2.1.1 iniconfig-2.0.0 isort-5.13.2 mypy-1.13.0 mypy-extensions-1.0.0 pathspec-0.12.1 platformdirs-4.3.6 pluggy-1.5.0 pytest-8.3.3 pytest-xdist-3.6.1 ruff-0.7.1 typing-extensions-4.12.2
Warning: Treating docker as a formula. For the cask, use homebrew/cask/docker or specify the `--cask` flag. To silence this message, use the `--formula` flag.
==> Downloading https://ghcr.io/v2/homebrew/core/docker/manifests/27.3.1
==> Fetching dependencies for docker: docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/manifests/27.3.1
==> Fetching docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/blobs/sha256:d5e13e8755e02db6eee3448b95d8ce3acef2ca77f5edd5d57e70c8ca29e72982
==> Fetching docker
==> Downloading https://ghcr.io/v2/homebrew/core/docker/blobs/sha256:dcd25100f823e80d665ce0bed51fe50[16](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:17)a4839669cb8bbfbb2e5be0e26dcc545
==> Installing dependencies for docker: docker-completion
==> Installing docker dependency: docker-completion
==> Downloading https://ghcr.io/v2/homebrew/core/docker-completion/manifests/27.3.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/1263cdb88b6345d8473b526b63d34f02d95608dceaa69c6c4da074a8e9d3702b--docker-completion-27.3.1.bottle_manifest.json
==> Pouring docker-completion--27.3.1.all.bottle.tar.gz
🍺  /opt/homebrew/Cellar/docker-completion/27.3.1: 10 files, 342.2KB
==> Installing docker
==> Pouring docker--27.3.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/docker/27.3.1: 14 files, 25.6MB
==> Downloading https://ghcr.io/v2/homebrew/core/colima/manifests/0.7.5
==> Fetching dependencies for colima: capstone, dtc, libslirp, libssh, ncurses, snappy, vde, qemu and lima
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/manifests/5.0.3
==> Fetching capstone
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/blobs/sha256:2c1c08af469f0307469b70ff6c277d5971495db3a8c7ae38c98bd2c70745acbb
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/manifests/1.7.1
==> Fetching dtc
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/blobs/sha256:eb7120f37159256116e64121d375138261b8c72ffe81ef7291a3857d0360b732
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/manifests/4.8.0
==> Fetching libslirp
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/blobs/sha256:6c4d57761e16cc3a1cd0a9c02147d28072e80159d38bdb90216e980d51deb265
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/manifests/0.11.1
==> Fetching libssh
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/blobs/sha256:0a6184ee3bcd7d1ef5deb30a1534d04a90ba4f6070eddd5a05fe75b9acc20ea1
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/manifests/6.5
==> Fetching ncurses
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/blobs/sha256:ee5253473badfa0701deac8e9973a7358c761dd287f0d748f753130a7a6d2705
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/manifests/1.2.1
==> Fetching snappy
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/blobs/sha256:2b905dfed7d6c0b44de9c89a79a6aa69824758c2727dcffe95bc6ebef465cf3f
==> Downloading https://ghcr.io/v2/homebrew/core/vde/manifests/2.3.3
==> Fetching vde
==> Downloading https://ghcr.io/v2/homebrew/core/vde/blobs/sha256:3d2231810ad7229ba6a68[17](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:18)8d648ab1f13bdfe50b214cb2d299d644d66e03762
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/manifests/9.1.1
==> Fetching qemu
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/blobs/sha256:0f3764292c3cf30b0f5b2c8636768feade7c733a8b61beea8109fa1ef7df86cd
==> Downloading https://ghcr.io/v2/homebrew/core/lima/manifests/0.23.2
==> Fetching lima
==> Downloading https://ghcr.io/v2/homebrew/core/lima/blobs/sha256:be8e2b92961eca2f862f1a994dbef367e86d36705a705ebfa16d21c7f1366c35
==> Fetching colima
==> Downloading https://ghcr.io/v2/homebrew/core/colima/blobs/sha256:242c7c[18](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:19)09ab130b98d733c0b[19](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:20)46a3d9bd3ba2a8f35d5afea40ab0e6643d9a3
==> Installing dependencies for colima: capstone, dtc, libslirp, libssh, ncurses, snappy, vde, qemu and lima
==> Installing colima dependency: capstone
==> Downloading https://ghcr.io/v2/homebrew/core/capstone/manifests/5.0.3
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/f77d59d4c25d40ffcd60c4[20](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:21)fbcd75fc7821fdaec8c04b54dca354ecb3dd9384--capstone-5.0.3.bottle_manifest.json
==> Pouring capstone--5.0.3.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/capstone/5.0.3: 31 files, 22.4MB
==> Installing colima dependency: dtc
==> Downloading https://ghcr.io/v2/homebrew/core/dtc/manifests/1.7.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/9af2d1bdcb1bf2aa3d63869290ab4a3627ffd6cbabca2be328f51ec71bdd0150--dtc-1.7.1.bottle_manifest.json
==> Pouring dtc--1.7.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/dtc/1.7.1: 19 files, 626.4KB
==> Installing colima dependency: libslirp
==> Downloading https://ghcr.io/v2/homebrew/core/libslirp/manifests/4.8.0
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/6d0118aaacae7b522b8c6fd6c5a20c3d5ed9e43c01253fb70ef514620a3bfedf--libslirp-4.8.0.bottle_manifest.json
==> Pouring libslirp--4.8.0.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libslirp/4.8.0: 12 files, 412.5KB
==> Installing colima dependency: libssh
==> Downloading https://ghcr.io/v2/homebrew/core/libssh/manifests/0.11.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/3591f41514c0ebe698a36753dce13e71fa33363993429a04af0da249f1eea04c--libssh-0.11.1.bottle_manifest.json
==> Pouring libssh--0.11.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/libssh/0.11.1: 25 files, 1.4MB
==> Installing colima dependency: ncurses
==> Downloading https://ghcr.io/v2/homebrew/core/ncurses/manifests/6.5
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/b2f8ce4e08b15832435170efd265346225ee388d5baab3d5c50e3a77c5673b5a--ncurses-6.5.bottle_manifest.json
==> Pouring ncurses--6.5.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/ncurses/6.5: 4,052 files, 9.9MB
==> Installing colima dependency: snappy
==> Downloading https://ghcr.io/v2/homebrew/core/snappy/manifests/1.2.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/b2e6bfcdbddf1d451a8dbbb6fc3c44a267b753ac1a889dbb0b9159bf31dacdd5--snappy-1.2.1.bottle_manifest.json
==> Pouring snappy--1.2.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/snappy/1.2.1: 19 files, 172.2KB
==> Installing colima dependency: vde
==> Downloading https://ghcr.io/v2/homebrew/core/vde/manifests/2.3.3
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/4e9503141162571c2cd[21](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:22)e89a9e61f524a7403ffe5ffe269f4a39ce5aef9f210--vde-2.3.3.bottle_manifest.json
==> Pouring vde--2.3.3.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/vde/2.3.3: 67 files, 1.3MB
==> Installing colima dependency: qemu
==> Downloading https://ghcr.io/v2/homebrew/core/qemu/manifests/9.1.1
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/1657512e610a3e8252efe616e2da3fe2a86b7d68dd73739430341c31397c857b--qemu-9.1.1.bottle_manifest.json
==> Pouring qemu--9.1.1.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/qemu/9.1.1: 165 files, 644.9MB
==> Installing colima dependency: lima
==> Downloading https://ghcr.io/v2/homebrew/core/lima/manifests/0.23.2
Already downloaded: /Users/runner/Library/Caches/Homebrew/downloads/157f4cc1e8c9189dbe09385cc33c8e9ceebfdadba9[22](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:23)60aaa5c22c59a922d31c--lima-0.23.2.bottle_manifest.json
==> Pouring lima--0.[23](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:24).2.arm64_sonoma.bottle.tar.gz
🍺  /opt/homebrew/Cellar/lima/0.23.2: 109 files, 202.5MB
==> Installing colima
==> Pouring colima--0.7.5.arm64_sonoma.bottle.tar.gz
==> Caveats
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
==> Summary
🍺  /opt/homebrew/Cellar/colima/0.7.5: 11 files, 5.7MB
==> Caveats
==> colima
Bash completion has been installed to:
  /opt/homebrew/etc/bash_completion.d
To start colima now and restart at login:
  brew services start colima
Or, if you don't want/need a background service you can just run:
  /opt/homebrew/opt/colima/bin/colima start -f
time="20[24](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:25)-10-31T07:53:51Z" level=info msg="starting colima"
time="2024-10-31T07:53:51Z" level=info msg="runtime: docker"
time="2024-10-31T07:53:53Z" level=info msg="creating and starting ..." context=vm
time="2024-10-31T07:53:54Z" level=info msg="downloading disk image ..." context=vm
                                                                           0.0%
                                                                           1.1%
##                                                                         3.3%
####                                                                       5.7%
######                                                                     8.6%
#######                                                                   11.0%
#########                                                                 13.5%
###########                                                               15.9%
#############                                                             18.4%
###############                                                           20.8%
################                                                          23.2%
##################                                                        [25](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:26).7%
####################                                                      28.2%
#####################                                                     30.5%
#######################                                                   32.9%
#########################                                                 35.3%
###########################                                               37.8%
############################                                              40.1%
##############################                                            42.4%
################################                                          44.7%
#################################                                         47.1%
###################################                                       49.4%
#####################################                                     51.8%
#######################################                                   54.2%
########################################                                  56.6%
##########################################                                58.9%
###########################################                               61.1%
#############################################                             63.5%
###############################################                           66.0%
#################################################                         69.2%
###################################################                       71.8%
#####################################################                     74.2%
#######################################################                   76.8%
#########################################################                 79.3%
##########################################################                81.7%
############################################################              84.4%
##############################################################            86.7%
################################################################          89.0%
#################################################################         91.3%
###################################################################       93.7%
#####################################################################     96.1%
######################################################################    98.4%
######################################################################## 100.0%
time="2024-10-31T07:54:02Z" level=info msg="Terminal is not available, proceeding without opening an editor"
time="2024-10-31T07:54:02Z" level=info msg="Starting the instance \"colima\" with VM driver \"qemu\""
time="2024-10-31T07:54:02Z" level=info msg="QEMU binary \"/opt/homebrew/bin/qemu-system-aarch64\" seems properly signed with the \"com.apple.security.hypervisor\" entitlement"
time="2024-10-31T07:54:02Z" level=info msg="Attempting to download the image" arch=aarch64 digest= location=/Users/runner/Library/Caches/colima/caches/fc0bfb9256e1f61294f2c41fc95ff4feb6c0daafccfb3b435e2d972e39bc8432.raw
time="2024-10-31T07:54:02Z" level=info msg="Downloaded the image from \"/Users/runner/Library/Caches/colima/caches/fc0bfb9256e1f61294f2c41fc95ff4feb6c0daafccfb3b435e2d972e39bc8432.raw\""
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] hostagent socket created at /Users/runner/.colima/_lima/colima/ha.sock"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Using system firmware (\"/opt/homebrew/share/qemu/edk2-aarch64-code.fd\")"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Starting QEMU (hint: to watch the boot progress, see \"/Users/runner/.colima/_lima/colima/serial*.log\")"
time="2024-10-31T07:54:03Z" level=info msg="SSH Local Port: 49[27](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:28)5"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Waiting for the essential requirement 1 of 4: \"ssh\""
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Driver stopped due to error: \"signal: abort trap\""
time="2024-10-[31](https://github.com/zackees/fastled-wasm/actions/runs/11608069919/job/32322608868#step:6:32)T07:54:03Z" level=info msg="[hostagent] Shutting down the host agent"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] failed to exit SSH master" error="failed to execute `ssh -O exit -p 49275 127.0.0.1`, out=\"Control socket connect(/Users/runner/.colima/_lima/colima/ssh.sock): No such file or directory\\r\\n\": exit status 255"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] Shutting down QEMU with ACPI"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] Failed to remove SSH binding for port 49275"
time="2024-10-31T07:54:03Z" level=warning msg="[hostagent] failed to open the QMP socket \"/Users/runner/.colima/_lima/colima/qmp.sock\", forcibly killing QEMU" error="dial unix /Users/runner/.colima/_lima/colima/qmp.sock: connect: connection refused"
time="2024-10-31T07:54:03Z" level=info msg="[hostagent] QEMU has already exited"
time="2024-10-31T07:54:03Z" level=fatal msg="exiting, status={Running:false Degraded:false Exiting:true Errors:[] SSHLocalPort:0} (hint: see \"/Users/runner/.colima/_lima/colima/ha.stderr.log\")"
time="2024-10-31T07:54:03Z" level=fatal msg="error starting vm: error at 'creating and starting': exit status 1"

Here is my github script:

name: Build Compiler for Docker arm64

on: [push]

jobs:
  test:
    runs-on: ${{ matrix.os }}
    strategy:
      matrix:
        python-version: [3.11]
        os: [macos-latest-xlarge]


    steps:
    - uses: actions/checkout@v4
    - name: Set up Python ${{ matrix.python-version }}
      uses: actions/setup-python@v4
      with:
        python-version: ${{ matrix.python-version }}
    - uses: docker-practice/actions-setup-docker@master
      timeout-minutes: 25



    - name: Print platform and cpu arch
      run: |
        echo "platform=$(uname -s)"
        echo "cpu_arch=$(uname -m)"
        echo "cpu_arch=$(uname -m)"

    - name: Install dependencies And run.
      run: |
        bash install
        brew install docker
        brew install colima
        colima nerdctl install
        colima start
        python build_docker_image.py --docker-pass ${{ secrets.DOCKER_PASSWORD }}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants
@jeremiah @abiosoft @bodsch @zackees @michielsarne2 and others