�[2malpha # [  109.191791] sshd[1628]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)�[0m
�[2malpha # [  109.196831] systemd-logind[719]: New session 25 of user root.�[0m
�[2malpha # [  109.197776] systemd[1]: Started Session 25 of User root.�[0m
�[2mgamma # [  109.216536] sshd[1597]: Accepted publickey for root from 192.168.1.3 port 36974 ssh2: ECDSA SHA256:+oCBm1A1Mzt3CuOnz392raccJznodBlQkGTcQQa5HUg�[0m
�[2mgamma # [  109.218666] sshd[1597]: pam_unix(sshd:session): session opened for user root(uid=0) by (uid=0)�[0m
�[2mgamma # [  109.223769] systemd-logind[719]: New session 26 of user root.�[0m
�[2mgamma # [  109.224754] systemd[1]: Started Session 26 of User root.�[0m
�[2malpha # [  109.267077] systemd[1]: post-activation-key.service: Deactivated successfully.�[0m
�[2malpha # [  109.268029] sshd[1628]: Received disconnect from 192.168.1.3 port 48064:11: disconnected by user�[0m
�[2mdeployer # alpha | Uploaded keys (post-activation)�[0m
�[2malpha # [  109.268712] sshd[1628]: Disconnected from user root 192.168.1.3 port 48064�[0m
�[2malpha # [  109.270047] sshd[1628]: pam_unix(sshd:session): session closed for user root�[0m
�[2malpha # [  109.272187] systemd-logind[719]: Session 25 logged out. Waiting for processes to exit.�[0m
�[2malpha # [  109.273409] systemd[1]: session-25.scope: Deactivated successfully.�[0m
�[2malpha # [  109.275882] systemd-logind[719]: Removed session 25.�[0m
�[2mgamma # [  109.293789] systemd[1]: post-activation-key.service: Deactivated successfully.�[0m
�[2mgamma # [  109.294726] sshd[1597]: Received disconnect from 192.168.1.3 port 36974:11: disconnected by user�[0m
�[2mgamma # [  109.295278] sshd[1597]: Disconnected from user root 192.168.1.3 port 36974�[0m
�[2mdeployer # gamma | Uploaded keys (post-activation)�[0m
�[2mdeployer #       | Failed: Child process exited with error code: 1�[0m
�[2mgamma # [  109.295795] sshd[1597]: pam_unix(sshd:session): session closed for user root�[0m
�[2mgamma # [  109.298415] systemd-logind[719]: Session 26 logged out. Waiting for processes to exit.�[0m
�[2mgamma # [  109.299461] systemd[1]: session-26.scope: Deactivated successfully.�[0m
�[2mgamma # [  109.301879] systemd-logind[719]: Removed session 26.�[0m
�[2malpha # [  109.391438] systemd[1]: post-activation-key.service: Scheduled restart job, restart counter is at 1.�[0m
�[2malpha # [  109.391936] systemd[1]: Stopped post-activation-key.service.�[0m
�[2malpha # [  109.392707] systemd[1]: Starting post-activation-key.service...�[0m
�[2malpha # [  109.396744] post-activation-key-pre-start[1638]: flapped down�[0m
�[2malpha # [  109.397552] systemd[1]: post-activation-key.service: Found left-over process 1639 (post-activation) in control group while starting unit. Ignoring.�[0m
�[2malpha # [  109.398165] systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.�[0m
�[2malpha # [  109.399746] systemd[1]: Started post-activation-key.service.�[0m
�[2mgamma # [  109.400911] systemd[1]: post-activation-key.service: Scheduled restart job, restart counter is at 1.�[0m
�[2mgamma # [  109.401441] systemd[1]: Stopped post-activation-key.service.�[0m
�[2mgamma # [  109.402688] systemd[1]: Starting post-activation-key.service...�[0m
�[2mgamma # [  109.406081] post-activation-key-pre-start[1607]: flapped down�[0m
�[2mgamma # [  109.406892] systemd[1]: post-activation-key.service: Found left-over process 1608 (post-activation) in control group while starting unit. Ignoring.�[0m
�[2mgamma # [  109.407509] systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.�[0m
�[2mgamma # [  109.408675] systemd[1]: Started post-activation-key.service.�[0m
�[2mdeployer # [ERROR] Failed to push system closure to beta - Last 5 lines of logs:�[0m
�[2mdeployer # [ERROR]  created)�[0m
�[2mdeployer # [ERROR]    state) Running�[0m
�[2mdeployer # [ERROR]   stderr) ssh: connect to host beta port 22: Connection refused�[0m
�[2mdeployer # [ERROR]   stderr) error: cannot connect to 'root@beta'�[0m
�[2mdeployer # [ERROR]  failure) Child process exited with error code: 1�[0m
�[2mdeployer # [ERROR] Failed to complete requested operation - Last 1 lines of logs:�[0m
�[2mdeployer # [ERROR]  failure) Child process exited with error code: 1�[0m
�[2mdeployer # [ERROR] -----�[0m
�[2mdeployer # [ERROR] Operation failed with error: Child process exited with error code: 1�[0m
�[2mdeployer # Hint: Backtrace available - Use `RUST_BACKTRACE=1` environment variable to display a backtrace�[0m
(finished: must fail: cd /tmp/bundle &&/nix/store/35knqkxmy1h5ckfxd280cmmry268v05q-colmena-0.5.0-pre/bin/colmena apply --evaluator chunked --eval-node-limit 4 --on @target, in 19.40 seconds)
alpha: �[1m�[32mmust succeed: grep SECOND /etc/deployment�[0m
(finished: must succeed: grep SECOND /etc/deployment, in 0.01 seconds)
beta: �[1m�[32mmust succeed: grep FIRST /etc/deployment�[0m
(finished: must succeed: grep FIRST /etc/deployment, in 0.01 seconds)
gamma: �[1m�[32mmust succeed: grep SECOND /etc/deployment�[0m
(finished: must succeed: grep SECOND /etc/deployment, in 0.01 seconds)
(finished: subtest: Check that we can correctly deploy to remaining nodes despite failures, in 19.45 seconds)
�[1m�[32msubtest: Check that key contents are not in the Nix store�[0m
deployer: �[1m�[32mmust succeed: ls /nix/store�[0m
(finished: must succeed: ls /nix/store, in 0.02 seconds)
deployer: 785 store paths were created
(finished: subtest: Check that key contents are not in the Nix store, in 0.26 seconds)
�[1m�[32msubtest: Check that our Nix store test is actually working�[0m
deployer: �[1m�[32mmust succeed: nix-build -E 'with import <nixpkgs> {}; writeText "forbidden-text.txt" "this must not appear in the nix store"'�[0m
�[2mdeployer # this derivation will be built:�[0m
�[2mdeployer #   /nix/store/k93774d6hwh91zqdnwbssgbgairq545x-forbidden-text.txt.drv�[0m
�[2mdeployer # building '/nix/store/k93774d6hwh91zqdnwbssgbgairq545x-forbidden-text.txt.drv'...�[0m
(finished: must succeed: nix-build -E 'with import <nixpkgs> {}; writeText "forbidden-text.txt" "this must not appear in the nix store"', in 0.22 seconds)
deployer: �[1m�[32mmust succeed: ls /nix/store�[0m
(finished: must succeed: ls /nix/store, in 0.02 seconds)
deployer: 787 store paths were created
deployer: �[1m�[32mmust succeed: grep -r 'this must not appear in the nix store' /nix/store/vj0bdi1safixikxy4mdd52dk78cyy801-django_3_set_zoneinfo_dir.patch.drv /nix/store/rz4py3bzcycbanmzn50h21f4j0277nd6-source.drv /nix/store/wn7q383y4r03jnnby857c7pm8mvpi46f-adler-1.0.2.drv /nix/store/x4m3vzw3s0x546rwp84x8jvbypf0wy9d-gobject-introspection-wrapped-1.76.1.drv /nix/store/b1fg3787x4plq63ra5gpl4zz47ma1d9l-unit-systemd-fsck-.service /nix/store/8xz2wfqpdcfvpf1diny2lfssfvjrprq4-python3.10-cryptography-40.0.1.drv /nix/store/ay7qxkqhhk0xfa5chkpljmkmcwgdlvgz-skia-pathops-0.7.4.zip.drv /nix/store/y8b6fclg1cn548d9ir8qlnpmsd93gz8f-sphinx-autoapi-2.0.1.ta…
(finished: must succeed: grep -r 'this must not appear in the nix store' /nix/store/vj0bdi1safixikxy4mdd52dk78cyy801-django_3_set_zoneinfo_dir.patch.drv /nix/store/rz4py3bzcycbanmzn50h21f4j0277nd6-source.drv /nix/store/wn7q383y4r03jnnby857c7pm8mvpi46f-adler-1.0.2.drv /nix/store/x4m3vzw3s0x546rwp84x8jvbypf0wy9d-gobject-introspection-wrapped-1.76.1.drv /nix/store/b1fg3787x4plq63ra5gpl4zz47ma1d9l-unit-systemd-fsck-.service /nix/store/8xz2wfqpdcfvpf1diny2lfssfvjrprq4-python3.10-cryptography-40.0.1.drv /nix/store/ay7qxkqhhk0xfa5chkpljmkmcwgdlvgz-skia-pathops-0.7.4.zip.drv /nix/store/y8b6fclg1cn548d9ir8qlnpmsd93gz8f-sphinx-autoapi-2.0.1.tar.gz.drv…
(finished: subtest: Check that our Nix store test is actually working, in 0.47 seconds)
�[1m�[32msubtest: Check that we can build nodes with dots in their names�[0m
deployer: �[1m�[32mmust succeed: cd /tmp/bundle &&/nix/store/35knqkxmy1h5ckfxd280cmmry268v05q-colmena-0.5.0-pre/bin/colmena build --evaluator chunked --eval-node-limit 4 --on gamma.tld�[0m
�[2mdeployer # [INFO ] Using configuration: /tmp/bundle/hive.nix�[0m
�[2mdeployer # [INFO ] Enumerating nodes...�[0m
�[2mdeployer # [INFO ] Selected 1 out of 5 hosts.�[0m
�[2mdeployer # gamma.tld | Evaluating gamma.tld�[0m
�[2mdeployer # gamma.tld | Evaluated gamma.tld�[0m
�[2mdeployer # gamma.tld | Building gamma.tld�[0m
�[2mdeployer # gamma.tld | /nix/store/8c1qb58pbq0nwi9pkvfml89hw6hrdgp5-nixos-system-gamma-23.05pre-git�[0m
�[2mdeployer # gamma.tld | Built "/nix/store/8c1qb58pbq0nwi9pkvfml89hw6hrdgp5-nixos-system-gamma-23.05pre-git"�[0m
�[2mdeployer #           | All done!�[0m
(finished: must succeed: cd /tmp/bundle &&/nix/store/35knqkxmy1h5ckfxd280cmmry268v05q-colmena-0.5.0-pre/bin/colmena build --evaluator chunked --eval-node-limit 4 --on gamma.tld, in 5.29 seconds)
(finished: subtest: Check that we can build nodes with dots in their names, in 5.29 seconds)
(finished: run the VM test script, in 117.47 seconds)
test script finished in 117.52s
�[1m�[32mcleanup�[0m
kill machine (pid 8)
�[2malpha # qemu-kvm: terminating on signal 15 from pid 6 (/nix/store/bc45k1n0pkrdkr3xa6w84w1xhkl1kkyp-python3-3.10.12/bin/python3.10)�[0m
kill machine (pid 19)
�[2mbeta # qemu-kvm: terminating on signal 15 from pid 6 (/nix/store/bc45k1n0pkrdkr3xa6w84w1xhkl1kkyp-python3-3.10.12/bin/python3.10)�[0m
kill machine (pid 30)
�[2mdeployer # qemu-kvm: terminating on signal 15 from pid 6 (/nix/store/bc45k1n0pkrdkr3xa6w84w1xhkl1kkyp-python3-3.10.12/bin/python3.10)�[0m
kill machine (pid 41)
�[2mgamma # qemu-kvm: terminating on signal 15 from pid 6 (/nix/store/bc45k1n0pkrdkr3xa6w84w1xhkl1kkyp-python3-3.10.12/bin/python3.10)�[0m
(finished: cleanup, in 0.25 seconds)
kill vlan (pid 7)