build(deps): bump github.com/onsi/gomega from 1.30.0 to 1.31.1 #1933
Annotations
11 errors
Install new operator:
Install new operator#L1
Step ensuring user is logged in succeeds: command 'oc login -u kubeadmin -p MSVpW-TwkfL-uwXzu-ZhDmR https://api.crc.testing:6443', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: error: The server uses a certificate signed by unknown authority. You may need to use the --certificate-authority flag to provide the path to a certificate file for the certificate authority, or --insecure-skip-tls-verify to bypass the certificate check and use insecure connections.
|
Install new operator:
Install new operator#L1
Step ensuring user is logged in succeeds: command 'oc login -u kubeadmin -p sKgCR-affZi-bv9XJ-NEM2H https://api.crc.testing:6443', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: error: The server uses a certificate signed by unknown authority. You may need to use the --certificate-authority flag to provide the path to a certificate file for the certificate authority, or --insecure-skip-tls-verify to bypass the certificate check and use insecure connections.
|
Mirror image to OpenShift image registry:
Mirror image to OpenShift image registry#L1
Step ensuring user is logged in succeeds: command 'oc login -u kubeadmin -p biJmi-uBBVw-izoQM-ZJjIQ https://api.crc.testing:6443', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: error: The server uses a certificate signed by unknown authority. You may need to use the --certificate-authority flag to provide the path to a certificate file for the certificate authority, or --insecure-skip-tls-verify to bypass the certificate check and use insecure connections.
|
Pull image locally, push to registry, deploy:
Pull image locally, push to registry, deploy#L1
Step pulling image "quay.io/centos7/httpd-24-centos7", logging in, and pushing local image to internal registry succeeds: error running C:\Users\rhqp\.crc\bin\oc\podman.exe push default-route-openshift-image-registry.apps-crc.testing/testproj/hello:test --tls-verify=false:
Command stdout:
stderr:
Getting image source signatures
Copying blob sha256:edce2a0bf77202cd1848777e8a15b7cdf2eca99a71d8cb46130b7a25be6475af
Copying blob sha256:53498d66ad83a29fcd7c7bcf4abbcc0def4fc912772aa8a4483b51e232309aee
Copying blob sha256:961b23c66ff99bb9060bf5677f8314bd3d451abe64ef3a97899e82d2dd9caff2
Error: writing blob: uploading layer to https://default-route-openshift-image-registry.apps-crc.testing/v2/testproj/hello/blobs/uploads/396ba2a8-b986-4fb9-b5a2-dffc4cdeae58?_state=YhGWpcqWOBThWR2F_g0TLNLSzXxJS_Xly4i5dD0IHRN7Ik5hbWUiOiJ0ZXN0cHJvai9oZWxsbyIsIlVVSUQiOiIzOTZiYTJhOC1iOTg2LTRmYjktYjVhMi1kZmZjNGNkZWFlNTgiLCJPZmZzZXQiOjEwMzk2NjQ4LCJTdGFydGVkQXQiOiIyMDI0LTAxLTMxVDExOjQ3OjQwWiJ9&digest=sha256%3A804040b303a21ba4cc3b7bba952ab135c19cf2a35728d6df9f81e6640a57a93a: StatusCode: 400,
error:
exit status 125
|
Install new operator:
Install new operator#L1
Step ensuring user is logged in succeeds: command 'oc login -u kubeadmin -p biJmi-uBBVw-izoQM-ZJjIQ https://api.crc.testing:6443', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: error: The server uses a certificate signed by unknown authority. You may need to use the --certificate-authority flag to provide the path to a certificate file for the certificate authority, or --insecure-skip-tls-verify to bypass the certificate check and use insecure connections.
|
Install new operator:
Install new operator#L1
Step with up to "60" retries with wait period of "5s" command "oc get taskruns" output matches "echo-task-run(.*)Succeeded.*": output did not match. Expected: 'echo-task-run(.*)Succeeded.*', Actual: 'NAME SUCCEEDED REASON STARTTIME COMPLETIONTIME
echo-task-run Unknown Pending 5m22s '
|
Overall cluster health:
Overall cluster health#L1
Step ensuring CRC cluster is running: command '$env:CRC_DISABLE_UPDATE_CHECK=true; crc start -n 10.75.5.25 -p 'C:\Users\rhqp\crc-e2e\pull-secret' ', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: true : The term 'true' is not recognized as the name of a cmdlet, function, script file, or operable program. Check
the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:31
+ $env:CRC_DISABLE_UPDATE_CHECK=true; crc start -n 10.75.5.25 -p 'C:\Us ...
+ ~~~~
+ CategoryInfo : ObjectNotFound: (true:String) [], CommandNotFoundException
+ FullyQualifiedErrorId : CommandNotFoundException
level=debug msg="CRC version: 2.32.0+adaec3\n"
level=debug msg="OpenShift version: 4.14.8\n"
level=debug msg="Podman version: 4.4.4\n"
level=debug msg="Running 'crc start'"
level=debug msg="Total memory of system is 34358562816 bytes"
level=debug msg="No new version available. The latest version is 2.31.0"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=info msg="Using bundle path C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64.crcbundle"
level=info msg="Checking minimum RAM requirements"
level=debug msg="Total memory of system is 34358562816 bytes"
level=info msg="Checking if running in a shell with administrator rights"
level=debug msg="Running '$currentPrincipal = New-Object Security.Principal.WindowsPrincipal([Security.Principal.WindowsIdentity]::GetCurrent());$currentPrincipal.IsInRole([Security.Principal.WindowsBuiltInRole]::Administrator)'"
level=info msg="Checking Windows release"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\" -Name ReleaseId).ReleaseId'"
level=info msg="Checking Windows edition"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\").EditionID'"
level=debug msg="Running on Windows Enterprise edition"
level=info msg="Checking if Hyper-V is installed and operational"
level=debug msg="Running '@(Get-Wmiobject Win32_ComputerSystem).HypervisorPresent'"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if Hyper-V service is enabled"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if crc-users group exists"
level=debug msg="Running 'Get-LocalGroup -Name crc-users'"
level=info msg="Checking if current user is in crc-users and Hyper-V admins group"
level=debug msg="Running '(Get-LocalGroupMember -Group 'crc-users').Name'"
level=debug msg="Checking current user is in the 'crc-user' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=debug msg="Running '(Get-LocalGroupMember -SID 'S-1-5-32-578').Name'"
level=debug msg="Checking current user is in the 'Hyper-v Administrators' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=info msg="Checking if vsock is correctly configured"
level=debug msg="Running 'Get-Item -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\\Virtualization\\GuestCommunicationServices\\00000400-FACB-11E6-BD58-64006A7986D3\"'"
level=info msg="Checking if the win32 background launcher is installed"
level=debug msg="Running '(Get-Item 'C:\\Program Files\\Red Hat OpenShift Local\\crc-background-launcher.exe').VersionInfo.FileVersion'"
level=debug msg="Found crc-background-launcher.exe version 0.0.0.1"
level=info msg="Checking if the daemon task is installed"
level=debug msg="Running 'Get-ScheduledTask -TaskName crcDaemon'"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").Version'"
level=info msg="Checking if the daemon task is running"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").State'"
level=info msg="Checking admin helper service is running"
level=debug msg="Running '(Get-Service crcAdminHelper).Status'"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Loading bundle: crc_hyperv_4.14.8_amd64..."
level=debug msg="Using secret from configuration"
level=info msg="Creating CRC VM for OpenShift 4.14.8..."
level=debug msg="Running pre-create checks..."
level=debug msg="Running '@(Get-Module -ListAvailable hyper-v).Name | Get-Unique'"
level=debug msg="Running '@([Security.Principal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole(([System.Security.Principal.SecurityIdentifier]::new(\"S-1-5-32-578\")))'"
level=debug msg="Creating machine..."
level=debug msg="Creating VM..."
level=debug msg="Running 'Hyper-V\\New-VM crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc' -MemoryStartupBytes 12000MB'"
level=debug msg="Running 'Hyper-V\\Remove-VMNetworkAdapter -VMName crc'"
level=debug msg="Running 'Hyper-V\\Set-VMMemory -VMName crc -DynamicMemoryEnabled $false'"
level=debug msg="Running 'Hyper-V\\Set-VMProcessor crc -Count 4'"
level=debug msg="Running 'Hyper-V\\Set-VM -VMName crc -AutomaticStartAction Nothing -AutomaticStopAction ShutDown -CheckpointType Disabled'"
level=debug msg="Running 'Hyper-V\\Add-VMHardDiskDrive -VMName crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx''"
level=debug msg="Running '@(Get-VHD -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx').Size'"
level=debug msg="C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx is already 33285996544 bytes"
level=info msg="Generating new SSH key pair..."
level=info msg="Generating new password for the kubeadmin user"
level=debug msg="Created C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Machine successfully created"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Starting CRC VM for openshift 4.14.8..."
level=debug msg="Updating CRC VM configuration"
level=debug msg="Running 'Hyper-V\\Start-VM crc'"
level=debug msg="Waiting for machine to be running, this may take a few minutes..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Machine is up and running!"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=info msg="CRC instance is running with IP 127.0.0.1"
level=debug msg="Waiting until ssh is available"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51814->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51814->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51815->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51815->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51816->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51816->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51818->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51818->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51820->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51820->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51821->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51821->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51822->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51822->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51824->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51824->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51825->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51825->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51826->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51826->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51827->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51827->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="CRC VM is running"
level=debug msg="Using root access: disable core user password"
level=debug msg="Running SSH command: sudo passwd --lock core"
level=debug msg="SSH command results: err: <nil>, output: Locking password for user core.\npasswd: Success\n"
level=debug msg="Running SSH command: cat /home/core/.ssh/authorized_keys"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=info msg="Updating authorized keys..."
level=debug msg="Creating /home/core/.ssh/authorized_keys with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Running SSH command: rm /home/core/.ssh/authorized_keys.d/ignition"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Get device id"
level=debug msg="Running SSH command: sudo /usr/sbin/blkid -t TYPE=xfs -o device"
level=debug msg="SSH command results: err: <nil>, output: /dev/sda4\n"
level=debug msg="Using root access: Growing /dev/sda4 partition"
level=debug msg="Running SSH command: sudo /usr/bin/growpart /dev/sda 4"
level=debug msg="SSH command results: err: Process exited with status 1, output: NOCHANGE: partition 4 is size 63961055. it cannot be grown\n"
level=debug msg="No free space after /dev/sda4, nothing to do"
level=debug msg="Running SSH command: cat /etc/resolv.conf"
level=debug msg="SSH command results: err: <nil>, output: nameserver 192.168.127.1\n"
level=info msg="Adding 10.75.5.25 as nameserver to the instance..."
level=debug msg="Running SSH command: NS=10.75.5.25; cat /etc/resolv.conf |grep -i \"^nameserver $NS\" || echo \"nameserver $NS\" | sudo tee -a /etc/resolv.conf"
level=debug msg="SSH command results: err: <nil>, output: nameserver 10.75.5.25\n"
level=debug msg="Using root access: make root Podman socket accessible"
level=debug msg="Running SSH command: sudo chmod 777 /run/podman/ /run/podman/podman.sock"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Creating /etc/resolv.conf with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: host -R 3 foo.apps-crc.testing"
level=debug msg="SSH command results: err: <nil>, output: foo.apps-crc.testing has address 192.168.127.2\n"
level=info msg="Check internal and public DNS query..."
level=debug msg="Running SSH command: curl --head quay.io"
level=debug msg="SSH command results: err: <nil>, output: HTTP/1.1 301 Moved Permanently\r\nServer: awselb/2.0\r\nDate: Wed, 31 Jan 2024 11:29:14 GMT\r\nContent-Type: text/html\r\nContent-Length: 134\r\nConnection: keep-alive\r\nLocation: https://quay.io:443/\r\n\r\n"
level=info msg="Check DNS query from host..."
level=debug msg="api.crc.testing resolved to [127.0.0.1]"
level=info msg="Verifying validity of the kubelet certificates..."
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-client-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:14+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-server-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:26+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /etc/kubernetes/static-pod-resources/kube-apiserver-certs/configmaps/aggregator-client-ca/ca-bundle.crt -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T11:00:02+00:00\n"
level=info msg="Starting kubelet service"
level=debug msg="Using root access: Executing systemctl daemon-reload command"
level=debug msg="Running SSH command: sudo systemctl daemon-reload"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Executing systemctl start kubelet"
level=debug msg="Running SSH command: sudo systemctl start kubelet"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Waiting for kube-apiserver availability... [takes around 2min]"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:19.133164 2277 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:19.134637 2277 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:19.136654 2277 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:19.138810 2277 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:19.140643 2277 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:20.331027 2301 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:20.331833 2301 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:20.333747 2301 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:20.335595 2301 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:20.337032 2301 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:21.695501 2321 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:21.700457 2321 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:21.705434 2321 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:21.710499 2321 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:21.715676 2321 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:23.089040 2342 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:23.094384 2342 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:23.099375 2342 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:23.104366 2342 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:23.110283 2342 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:24.402874 2363 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:24.404733 2363 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:24.405814 2363 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:24.406933 2363 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:24.407609 2363 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:25.669248 2384 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:25.674297 2384 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:25.679315 2384 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:25.684469 2384 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:25.689584 2384 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:27.032664 2405 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:27.034559 2405 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:27.036199 2405 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:27.037428 2405 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:27.038956 2405 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:28.303415 2451 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:28.305625 2451 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:28.306932 2451 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:28.308055 2451 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:28.309055 2451 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:29.470185 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:29.471770 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:29.473198 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:29.474137 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:29.476408 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:29:30.697809 2928 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:30.705047 2928 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:30.707927 2928 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:30.710065 2928 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:29:30.711022 2928 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 12"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 13"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="Waiting for availability of resource type 'configmap'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get configmap --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="Running SSH command: timeout 30s oc delete -n openshift-machine-config-operator configmap machine-config-controller --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="Waiting for availability of resource type 'lease'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get lease --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug
level=debug msg="Running SSH command: timeout 30s oc delete -A lease --all --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: lease.coordination.k8s.io \"crc-ksq4m-master-0\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-authentication-operator-lock\" deleted\nlease.coordination.k8s.io \"cloud-credential-operator-leader\" deleted\nlease.coordination.k8s.io \"cluster-machine-approver-leader\" deleted\nlease.coordination.k8s.io \"version\" deleted\nlease.coordination.k8s.io \"config-operator-lock\" deleted\nlease.coordination.k8s.io \"console-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"openshift-cluster-etcd-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"kube-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-regeneration-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-cluster-kube-scheduler-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-kube-storage-version-migrator-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-healthcheck-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-libvirt-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-machineset-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-nodelink-leader\" deleted\nlease.coordination.k8s.io \"control-plane-machine-set-leader\" deleted\nlease.coordination.k8s.io \"machine-api-operator\" deleted\nlease.coordination.k8s.io \"machine-config\" deleted\nlease.coordination.k8s.io \"machine-config-controller\" deleted\nlease.coordination.k8s.io \"marketplace-operator-lock\" deleted\nlease.coordination.k8s.io \"ovnkube-identity\" deleted\nlease.coordination.k8s.io \"network-operator-lock\" deleted\nlease.coordination.k8s.io \"packageserver-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-route-controllers\" deleted\nlease.coordination.k8s.io \"openshift-network-controller\" deleted\nlease.coordination.k8s.io \"service-ca-operator-lock\" deleted\nlease.coordination.k8s.io \"service-ca-controller-lock\" deleted\n"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Adding user's pull secret to the cluster..."
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'machineconfigs'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get machineconfigs --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\n"
level=debug msg="NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\n"
level=debug msg="Running SSH command: timeout 30s oc get machineconfigs 99-master-ssh -o jsonpath='{.spec.config.passwd.users[0].sshAuthorizedKeys[0]}' --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBABT3zAIbFRUQtr8XrXjedhqVzHdaG2ZIIYfQ4vDL+jF0o/yjA0YECbtvgZVFq/6u6jjMn7PdCvfZAgr9tI7Jag95wBvwoeS6Z4sjnt52DPIsqMcQKzKK+VOEcR5M0tbwPVOocRVWRFxQ5K/qMbb84/q18nhhuvHm4v34Lz/65v6MwtMzw== core"
level=info msg="Updating SSH key to machine config resource..."
level=debug msg="Running SSH command: timeout 30s oc patch machineconfig 99-master-ssh -p '{\"spec\": {\"config\": {\"passwd\": {\"users\": [{\"name\": \"core\", \"sshAuthorizedKeys\": [\"ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBADVSlOJRiI/IguZNIxmjZKFFxQhCwUTlk3kAHeAqU/AYa5hrG4pC3ZI8wYcpYCQeKJSXFg0R6ptRnqojVOVNsHjZwGI1w3BlC3QIuallm59Hqgdy2xOpp+oeBQ6lED/sbEYIwKYOma1m5LYSkXRrKKqSfAEZPIPS2rlQ4fYQDrcizC16A==\"]}]}}}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: machineconfig.machineconfiguration.openshift.io/99-master-ssh patched\n"
level=info msg="Waiting until the user's pull secret is written to the instance disk..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 12"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 13"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 14"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 15"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 16"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 17"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 18"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 19"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 20"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 21"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 22"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 23"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 24"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 25"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 26"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 27"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 28"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 29"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 30"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 31"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 32"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 33"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 34"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 35"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 36"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 37"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 38"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 39"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 40"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 41"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 42"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 43"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 44"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 45"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 46"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 47"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 48"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Changing the password for the kubeadmin user"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'clusterversion'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get clusterversion --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="Running SSH command: timeout 30s oc get clusterversion version -o jsonpath=\"{['spec']['clusterID']}\" --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Updating cluster ID..."
level=debug msg="Running SSH command: timeout 30s oc patch clusterversion version -p '{\"spec\":{\"clusterID\":\"7a695bb3-6d1c-45a5-92d8-14bc7885235e\"}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: clusterversion.config.openshift.io/version patched\n"
level=debug msg="Running SSH command: ls /opt/crc/routes-controller.yaml"
level=debug msg="SSH command results: err: <nil>, output: /opt/crc/routes-controller.yaml\n"
level=debug msg="Running SSH command: timeout 30s oc apply -f /opt/crc/routes-controller.yaml --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
ssh command error:
command : timeout 30s oc apply -f /opt/crc/routes-controller.yaml --context admin --cluster crc --kubeconfig /opt/kubeconfig
err : Process exited with status 124
|
Mirror image to OpenShift image registry:
Mirror image to OpenShift image registry#L1
Step ensuring CRC cluster is running: command '$env:CRC_DISABLE_UPDATE_CHECK=true; crc start -n 10.75.5.25 -p 'C:\Users\rhqp\crc-e2e\pull-secret' ', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: true : The term 'true' is not recognized as the name of a cmdlet, function, script file, or operable program. Check
the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:31
+ $env:CRC_DISABLE_UPDATE_CHECK=true; crc start -n 10.75.5.25 -p 'C:\Us ...
+ ~~~~
+ CategoryInfo : ObjectNotFound: (true:String) [], CommandNotFoundException
+ FullyQualifiedErrorId : CommandNotFoundException
level=debug msg="CRC version: 2.32.0+adaec3\n"
level=debug msg="OpenShift version: 4.14.8\n"
level=debug msg="Podman version: 4.4.4\n"
level=debug msg="Running 'crc start'"
level=debug msg="Total memory of system is 34358562816 bytes"
level=debug msg="No new version available. The latest version is 2.31.0"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=info msg="Using bundle path C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64.crcbundle"
level=info msg="Checking minimum RAM requirements"
level=debug msg="Total memory of system is 34358562816 bytes"
level=info msg="Checking if running in a shell with administrator rights"
level=debug msg="Running '$currentPrincipal = New-Object Security.Principal.WindowsPrincipal([Security.Principal.WindowsIdentity]::GetCurrent());$currentPrincipal.IsInRole([Security.Principal.WindowsBuiltInRole]::Administrator)'"
level=info msg="Checking Windows release"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\" -Name ReleaseId).ReleaseId'"
level=info msg="Checking Windows edition"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\").EditionID'"
level=debug msg="Running on Windows Enterprise edition"
level=info msg="Checking if Hyper-V is installed and operational"
level=debug msg="Running '@(Get-Wmiobject Win32_ComputerSystem).HypervisorPresent'"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if Hyper-V service is enabled"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if crc-users group exists"
level=debug msg="Running 'Get-LocalGroup -Name crc-users'"
level=info msg="Checking if current user is in crc-users and Hyper-V admins group"
level=debug msg="Running '(Get-LocalGroupMember -Group 'crc-users').Name'"
level=debug msg="Checking current user is in the 'crc-user' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=debug msg="Running '(Get-LocalGroupMember -SID 'S-1-5-32-578').Name'"
level=debug msg="Checking current user is in the 'Hyper-v Administrators' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=info msg="Checking if vsock is correctly configured"
level=debug msg="Running 'Get-Item -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\\Virtualization\\GuestCommunicationServices\\00000400-FACB-11E6-BD58-64006A7986D3\"'"
level=info msg="Checking if the win32 background launcher is installed"
level=debug msg="Running '(Get-Item 'C:\\Program Files\\Red Hat OpenShift Local\\crc-background-launcher.exe').VersionInfo.FileVersion'"
level=debug msg="Found crc-background-launcher.exe version 0.0.0.1"
level=info msg="Checking if the daemon task is installed"
level=debug msg="Running 'Get-ScheduledTask -TaskName crcDaemon'"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").Version'"
level=info msg="Checking if the daemon task is running"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").State'"
level=info msg="Checking admin helper service is running"
level=debug msg="Running '(Get-Service crcAdminHelper).Status'"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Loading bundle: crc_hyperv_4.14.8_amd64..."
level=debug msg="Using secret from configuration"
level=info msg="Creating CRC VM for OpenShift 4.14.8..."
level=debug msg="Running pre-create checks..."
level=debug msg="Running '@(Get-Module -ListAvailable hyper-v).Name | Get-Unique'"
level=debug msg="Running '@([Security.Principal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole(([System.Security.Principal.SecurityIdentifier]::new(\"S-1-5-32-578\")))'"
level=debug msg="Creating machine..."
level=debug msg="Creating VM..."
level=debug msg="Running 'Hyper-V\\New-VM crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc' -MemoryStartupBytes 12000MB'"
level=debug msg="Running 'Hyper-V\\Remove-VMNetworkAdapter -VMName crc'"
level=debug msg="Running 'Hyper-V\\Set-VMMemory -VMName crc -DynamicMemoryEnabled $false'"
level=debug msg="Running 'Hyper-V\\Set-VMProcessor crc -Count 4'"
level=debug msg="Running 'Hyper-V\\Set-VM -VMName crc -AutomaticStartAction Nothing -AutomaticStopAction ShutDown -CheckpointType Disabled'"
level=debug msg="Running 'Hyper-V\\Add-VMHardDiskDrive -VMName crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx''"
level=debug msg="Running '@(Get-VHD -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx').Size'"
level=debug msg="C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx is already 33285996544 bytes"
level=info msg="Generating new SSH key pair..."
level=info msg="Generating new password for the kubeadmin user"
level=debug msg="Created C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Machine successfully created"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Starting CRC VM for openshift 4.14.8..."
level=debug msg="Updating CRC VM configuration"
level=debug msg="Running 'Hyper-V\\Start-VM crc'"
level=debug msg="Waiting for machine to be running, this may take a few minutes..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Machine is up and running!"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=info msg="CRC instance is running with IP 127.0.0.1"
level=debug msg="Waiting until ssh is available"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52029->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52029->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52030->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52030->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52032->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52032->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52033->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52033->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52035->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52035->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52036->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52036->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52037->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52037->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52038->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52038->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52040->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52040->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:52041->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:52041->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="CRC VM is running"
level=debug msg="Using root access: disable core user password"
level=debug msg="Running SSH command: sudo passwd --lock core"
level=debug msg="SSH command results: err: <nil>, output: Locking password for user core.\npasswd: Success\n"
level=debug msg="Running SSH command: cat /home/core/.ssh/authorized_keys"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=info msg="Updating authorized keys..."
level=debug msg="Creating /home/core/.ssh/authorized_keys with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Running SSH command: rm /home/core/.ssh/authorized_keys.d/ignition"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Get device id"
level=debug msg="Running SSH command: sudo /usr/sbin/blkid -t TYPE=xfs -o device"
level=debug msg="SSH command results: err: <nil>, output: /dev/sda4\n"
level=debug msg="Using root access: Growing /dev/sda4 partition"
level=debug msg="Running SSH command: sudo /usr/bin/growpart /dev/sda 4"
level=debug msg="SSH command results: err: Process exited with status 1, output: NOCHANGE: partition 4 is size 63961055. it cannot be grown\n"
level=debug msg="No free space after /dev/sda4, nothing to do"
level=debug msg="Running SSH command: cat /etc/resolv.conf"
level=debug msg="SSH command results: err: <nil>, output: nameserver 192.168.127.1\n"
level=info msg="Adding 10.75.5.25 as nameserver to the instance..."
level=debug msg="Running SSH command: NS=10.75.5.25; cat /etc/resolv.conf |grep -i \"^nameserver $NS\" || echo \"nameserver $NS\" | sudo tee -a /etc/resolv.conf"
level=debug msg="SSH command results: err: <nil>, output: nameserver 10.75.5.25\n"
level=debug msg="Using root access: make root Podman socket accessible"
level=debug msg="Running SSH command: sudo chmod 777 /run/podman/ /run/podman/podman.sock"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Creating /etc/resolv.conf with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: host -R 3 foo.apps-crc.testing"
level=debug msg="SSH command results: err: <nil>, output: foo.apps-crc.testing has address 192.168.127.2\n"
level=info msg="Check internal and public DNS query..."
level=debug msg="Running SSH command: curl --head quay.io"
level=debug msg="SSH command results: err: <nil>, output: HTTP/1.1 301 Moved Permanently\r\nServer: awselb/2.0\r\nDate: Wed, 31 Jan 2024 11:40:43 GMT\r\nContent-Type: text/html\r\nContent-Length: 134\r\nConnection: keep-alive\r\nLocation: https://quay.io:443/\r\n\r\n"
level=info msg="Check DNS query from host..."
level=debug msg="api.crc.testing resolved to [127.0.0.1]"
level=info msg="Verifying validity of the kubelet certificates..."
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-client-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:14+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-server-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:26+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /etc/kubernetes/static-pod-resources/kube-apiserver-certs/configmaps/aggregator-client-ca/ca-bundle.crt -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T11:00:02+00:00\n"
level=info msg="Starting kubelet service"
level=debug msg="Using root access: Executing systemctl daemon-reload command"
level=debug msg="Running SSH command: sudo systemctl daemon-reload"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Executing systemctl start kubelet"
level=debug msg="Running SSH command: sudo systemctl start kubelet"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Waiting for kube-apiserver availability... [takes around 2min]"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:40:59.110606 2240 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:40:59.111931 2240 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:40:59.112904 2240 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:40:59.115159 2240 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:40:59.115996 2240 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:41:00.315806 2792 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:41:00.317030 2792 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:41:00.318917 2792 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:41:00.323506 2792 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:41:00.324556 2792 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="Waiting for availability of resource type 'configmap'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get configmap --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="Running SSH command: timeout 30s oc delete -n openshift-machine-config-operator configmap machine-config-controller --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="Waiting for availability of resource type 'lease'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get lease --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug
level=debug msg="Running SSH command: timeout 30s oc delete -A lease --all --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: lease.coordination.k8s.io \"crc-ksq4m-master-0\" deleted\nlease.coordination.k8s.io \"apiserver-5qmh3rbmw7r5gzivxgbio672c4\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-authentication-operator-lock\" deleted\nlease.coordination.k8s.io \"cloud-credential-operator-leader\" deleted\nlease.coordination.k8s.io \"cluster-machine-approver-leader\" deleted\nlease.coordination.k8s.io \"version\" deleted\nlease.coordination.k8s.io \"config-operator-lock\" deleted\nlease.coordination.k8s.io \"console-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"openshift-cluster-etcd-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"kube-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-regeneration-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-cluster-kube-scheduler-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-kube-storage-version-migrator-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-healthcheck-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-libvirt-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-machineset-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-nodelink-leader\" deleted\nlease.coordination.k8s.io \"control-plane-machine-set-leader\" deleted\nlease.coordination.k8s.io \"machine-api-operator\" deleted\nlease.coordination.k8s.io \"machine-config\" deleted\nlease.coordination.k8s.io \"machine-config-controller\" deleted\nlease.coordination.k8s.io \"marketplace-operator-lock\" deleted\nlease.coordination.k8s.io \"ovnkube-identity\" deleted\nlease.coordination.k8s.io \"network-operator-lock\" deleted\nlease.coordination.k8s.io \"packageserver-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-route-controllers\" deleted\nlease.coordination.k8s.io \"openshift-network-controller\" deleted\nlease.coordination.k8s.io \"service-ca-operator-lock\" deleted\nlease.coordination.k8s.io \"service-ca-controller-lock\" deleted\n"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Adding user's pull secret to the cluster..."
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'machineconfigs'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get machineconfigs --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\n"
level=debug msg="NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 20d\n"
level=debug msg="Running SSH command: timeout 30s oc get machineconfigs 99-master-ssh -o jsonpath='{.spec.config.passwd.users[0].sshAuthorizedKeys[0]}' --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBABT3zAIbFRUQtr8XrXjedhqVzHdaG2ZIIYfQ4vDL+jF0o/yjA0YECbtvgZVFq/6u6jjMn7PdCvfZAgr9tI7Jag95wBvwoeS6Z4sjnt52DPIsqMcQKzKK+VOEcR5M0tbwPVOocRVWRFxQ5K/qMbb84/q18nhhuvHm4v34Lz/65v6MwtMzw== core"
level=info msg="Updating SSH key to machine config resource..."
level=debug msg="Running SSH command: timeout 30s oc patch machineconfig 99-master-ssh -p '{\"spec\": {\"config\": {\"passwd\": {\"users\": [{\"name\": \"core\", \"sshAuthorizedKeys\": [\"ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBACJglAJhRAq/TFOb45Udd42gVm20GCR7Lj82Ok+BoqWbf0Dp+BDM6iBlHpJEV6ZmSlnHH0N+rWkEbwkAUtJwVrd7ABm/tISwGxBsQ8ocZTvgBZ6IqHDRZXh7ruky4nc3pm7/uWiPohJlPrtDmbuVaXqTpFlMrDV8mFs/NZXTPOaFDAvzQ==\"]}]}}}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: machineconfig.machineconfiguration.openshift.io/99-master-ssh patched\n"
level=info msg="Waiting until the user's pull secret is written to the instance disk..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 12"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 13"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 14"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 15"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 16"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 17"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 18"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 19"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 20"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 21"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 22"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 23"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 24"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 25"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 26"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 27"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 28"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 29"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 30"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 31"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 32"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 33"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Changing the password for the kubeadmin user"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'clusterversion'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get clusterversion --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="Running SSH command: timeout 30s oc get clusterversion version -o jsonpath=\"{['spec']['clusterID']}\" --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Updating cluster ID..."
level=debug msg="Running SSH command: timeout 30s oc patch clusterversion version -p '{\"spec\":{\"clusterID\":\"d9bd2df2-01f1-434f-a6be-19610bee04d6\"}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
Failed to update cluster ID: Failed to update cluster ID ssh command error:
command : timeout 30s oc patch clusterversion version -p '{"spec":{"clusterID":"d9bd2df2-01f1-434f-a6be-19610bee04d6"}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig
err : Process exited with status 1
: The connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?
|
Pull image locally, push to registry, deploy:
Pull image locally, push to registry, deploy#L1
Step pulling image "quay.io/centos7/httpd-24-centos7", logging in, and pushing local image to internal registry succeeds: error running C:\Users\rhqp\.crc\bin\oc\podman.exe push default-route-openshift-image-registry.apps-crc.testing/testproj/hello:test --tls-verify=false:
Command stdout:
stderr:
Getting image source signatures
Copying blob sha256:edce2a0bf77202cd1848777e8a15b7cdf2eca99a71d8cb46130b7a25be6475af
Copying blob sha256:53498d66ad83a29fcd7c7bcf4abbcc0def4fc912772aa8a4483b51e232309aee
Copying blob sha256:961b23c66ff99bb9060bf5677f8314bd3d451abe64ef3a97899e82d2dd9caff2
Copying config sha256:d7af31210b288164c319bae740ca1281528390a3c5cee657e95f243670b49e6a
Error: writing blob: checking whether a blob sha256:d7af31210b288164c319bae740ca1281528390a3c5cee657e95f243670b49e6a exists in default-route-openshift-image-registry.apps-crc.testing/testproj/hello: StatusCode: 400,
error:
exit status 125
|
Install new operator:
Install new operator#L1
Step ensuring user is logged in succeeds: command 'oc login -u kubeadmin -p MxRKk-hcGRY-eEUY9-GWkQP https://api.crc.testing:6443', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: error: The server uses a certificate signed by unknown authority. You may need to use the --certificate-authority flag to provide the path to a certificate file for the certificate authority, or --insecure-skip-tls-verify to bypass the certificate check and use insecure connections.
|
Start OpenShift cluster: #3:
Start OpenShift cluster: #3#L1
Step starting CRC with default bundle succeeds: command '$env:CRC_DISABLE_UPDATE_CHECK=true; crc start -p 'C:\Users\rhqp\crc-e2e\pull-secret' ', expected to succeed, exited with exit code: 1
Command stdout:
Command stderr: true : The term 'true' is not recognized as the name of a cmdlet, function, script file, or operable program. Check
the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:31
+ $env:CRC_DISABLE_UPDATE_CHECK=true; crc start -p 'C:\Users\rhqp\crc-e ...
+ ~~~~
+ CategoryInfo : ObjectNotFound: (true:String) [], CommandNotFoundException
+ FullyQualifiedErrorId : CommandNotFoundException
level=debug msg="CRC version: 2.32.0+adaec3\n"
level=debug msg="OpenShift version: 4.14.8\n"
level=debug msg="Podman version: 4.4.4\n"
level=debug msg="Running 'crc start'"
level=debug msg="Total memory of system is 34358562816 bytes"
level=debug msg="No new version available. The latest version is 2.31.0"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=info msg="Using bundle path C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64.crcbundle"
level=info msg="Checking minimum RAM requirements"
level=debug msg="Total memory of system is 34358562816 bytes"
level=info msg="Checking if running in a shell with administrator rights"
level=debug msg="Running '$currentPrincipal = New-Object Security.Principal.WindowsPrincipal([Security.Principal.WindowsIdentity]::GetCurrent());$currentPrincipal.IsInRole([Security.Principal.WindowsBuiltInRole]::Administrator)'"
level=info msg="Checking Windows release"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\" -Name ReleaseId).ReleaseId'"
level=info msg="Checking Windows edition"
level=debug msg="Running '(Get-ItemProperty -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\").EditionID'"
level=debug msg="Running on Windows Enterprise edition"
level=info msg="Checking if Hyper-V is installed and operational"
level=debug msg="Running '@(Get-Wmiobject Win32_ComputerSystem).HypervisorPresent'"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if Hyper-V service is enabled"
level=debug msg="Running '@(Get-Service vmms).Status'"
level=info msg="Checking if crc-users group exists"
level=debug msg="Running 'Get-LocalGroup -Name crc-users'"
level=info msg="Checking if current user is in crc-users and Hyper-V admins group"
level=debug msg="Running '(Get-LocalGroupMember -Group 'crc-users').Name'"
level=debug msg="Checking current user is in the 'crc-user' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=debug msg="Running '(Get-LocalGroupMember -SID 'S-1-5-32-578').Name'"
level=debug msg="Checking current user is in the 'Hyper-v Administrators' group"
level=debug msg="group members: qenvs563f07f9\\rhqp"
level=info msg="Checking if vsock is correctly configured"
level=debug msg="Running 'Get-Item -Path \"HKLM:\\SOFTWARE\\Microsoft\\Windows NT\\CurrentVersion\\Virtualization\\GuestCommunicationServices\\00000400-FACB-11E6-BD58-64006A7986D3\"'"
level=info msg="Checking if the win32 background launcher is installed"
level=debug msg="Running '(Get-Item 'C:\\Program Files\\Red Hat OpenShift Local\\crc-background-launcher.exe').VersionInfo.FileVersion'"
level=debug msg="Found crc-background-launcher.exe version 0.0.0.1"
level=info msg="Checking if the daemon task is installed"
level=debug msg="Running 'Get-ScheduledTask -TaskName crcDaemon'"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").Version'"
level=info msg="Checking if the daemon task is running"
level=debug msg="Running '(Get-ScheduledTask -TaskName \"crcDaemon\").State'"
level=info msg="Checking admin helper service is running"
level=debug msg="Running '(Get-Service crcAdminHelper).Status'"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Loading bundle: crc_hyperv_4.14.8_amd64..."
level=debug msg="Using secret from configuration"
level=info msg="Creating CRC VM for OpenShift 4.14.8..."
level=debug msg="Running pre-create checks..."
level=debug msg="Running '@(Get-Module -ListAvailable hyper-v).Name | Get-Unique'"
level=debug msg="Running '@([Security.Principal.WindowsPrincipal][Security.Principal.WindowsIdentity]::GetCurrent()).IsInRole(([System.Security.Principal.SecurityIdentifier]::new(\"S-1-5-32-578\")))'"
level=debug msg="Creating machine..."
level=debug msg="Creating VM..."
level=debug msg="Running 'Hyper-V\\New-VM crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc' -MemoryStartupBytes 9216MB'"
level=debug msg="Running 'Hyper-V\\Remove-VMNetworkAdapter -VMName crc'"
level=debug msg="Running 'Hyper-V\\Set-VMMemory -VMName crc -DynamicMemoryEnabled $false'"
level=debug msg="Running 'Hyper-V\\Set-VMProcessor crc -Count 4'"
level=debug msg="Running 'Hyper-V\\Set-VM -VMName crc -AutomaticStartAction Nothing -AutomaticStopAction ShutDown -CheckpointType Disabled'"
level=debug msg="Running 'Hyper-V\\Add-VMHardDiskDrive -VMName crc -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx''"
level=debug msg="Running '@(Get-VHD -Path 'C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx').Size'"
level=debug msg="C:\\Users\\rhqp\\.crc\\machines\\crc\\crc.vhdx is already 33285996544 bytes"
level=info msg="Generating new SSH key pair..."
level=info msg="Generating new password for the kubeadmin user"
level=debug msg="Created C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Machine successfully created"
level=debug msg="Checking file: C:\\Users\\rhqp\\.crc\\machines\\crc\\.crc-exist"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\oc.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\oc.exe'"
level=debug msg="Copying 'C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\podman.exe' to 'C:\\Users\\rhqp\\.crc\\bin\\oc\\podman.exe'"
level=info msg="Starting CRC VM for openshift 4.14.8..."
level=debug msg="Updating CRC VM configuration"
level=debug msg="Running 'Hyper-V\\Start-VM crc'"
level=debug msg="Waiting for machine to be running, this may take a few minutes..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=debug msg="Machine is up and running!"
level=debug msg="Running 'Hyper-V\\Get-VM crc | Select-Object -ExpandProperty State'"
level=info msg="CRC instance is running with IP 127.0.0.1"
level=debug msg="Waiting until ssh is available"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51496->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51496->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51497->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51497->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51498->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51498->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51500->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51500->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51502->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51502->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51503->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51503->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51504->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51504->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51506->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51506->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51508->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51508->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: ssh: handshake failed: read tcp 127.0.0.1:51509->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host., output: "
level=debug msg="error: Temporary error: ssh command error:\ncommand : exit 0\nerr : ssh: handshake failed: read tcp 127.0.0.1:51509->127.0.0.1:2222: wsarecv: An existing connection was forcibly closed by the remote host.\n - sleeping 1s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: exit 0"
level=debug msg="Using ssh private keys: [C:\\Users\\rhqp\\.crc\\machines\\crc\\id_ecdsa C:\\Users\\rhqp\\.crc\\cache\\crc_hyperv_4.14.8_amd64\\id_ecdsa_crc]"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="CRC VM is running"
level=debug msg="Using root access: disable core user password"
level=debug msg="Running SSH command: sudo passwd --lock core"
level=debug msg="SSH command results: err: <nil>, output: Locking password for user core.\npasswd: Success\n"
level=debug msg="Running SSH command: cat /home/core/.ssh/authorized_keys"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=info msg="Updating authorized keys..."
level=debug msg="Creating /home/core/.ssh/authorized_keys with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Running SSH command: rm /home/core/.ssh/authorized_keys.d/ignition"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Get device id"
level=debug msg="Running SSH command: sudo /usr/sbin/blkid -t TYPE=xfs -o device"
level=debug msg="SSH command results: err: <nil>, output: /dev/sda4\n"
level=debug msg="Using root access: Growing /dev/sda4 partition"
level=debug msg="Running SSH command: sudo /usr/bin/growpart /dev/sda 4"
level=debug msg="SSH command results: err: Process exited with status 1, output: NOCHANGE: partition 4 is size 63961055. it cannot be grown\n"
level=debug msg="No free space after /dev/sda4, nothing to do"
level=debug msg="Using root access: make root Podman socket accessible"
level=debug msg="Running SSH command: sudo chmod 777 /run/podman/ /run/podman/podman.sock"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Creating /etc/resolv.conf with permissions 0644 in the CRC VM"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: host -R 3 foo.apps-crc.testing"
level=debug msg="SSH command results: err: <nil>, output: foo.apps-crc.testing has address 192.168.127.2\n"
level=info msg="Check internal and public DNS query..."
level=debug msg="Running SSH command: curl --head quay.io"
level=debug msg="SSH command results: err: <nil>, output: HTTP/1.1 301 Moved Permanently\r\nServer: awselb/2.0\r\nDate: Wed, 31 Jan 2024 11:10:56 GMT\r\nContent-Type: text/html\r\nContent-Length: 134\r\nConnection: keep-alive\r\nLocation: https://quay.io:443/\r\n\r\n"
level=info msg="Check DNS query from host..."
level=debug msg="api.crc.testing resolved to [127.0.0.1]"
level=info msg="Verifying validity of the kubelet certificates..."
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-client-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:14+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /var/lib/kubelet/pki/kubelet-server-current.pem -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T10:57:26+00:00\n"
level=debug msg="Running SSH command: date --date=\"$(sudo openssl x509 -in /etc/kubernetes/static-pod-resources/kube-apiserver-certs/configmaps/aggregator-client-ca/ca-bundle.crt -noout -enddate | cut -d= -f 2)\" --iso-8601=seconds"
level=debug msg="SSH command results: err: <nil>, output: 2025-01-10T11:00:02+00:00\n"
level=info msg="Starting kubelet service"
level=debug msg="Using root access: Executing systemctl daemon-reload command"
level=debug msg="Running SSH command: sudo systemctl daemon-reload"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug msg="Using root access: Executing systemctl start kubelet"
level=debug msg="Running SSH command: sudo systemctl start kubelet"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Waiting for kube-apiserver availability... [takes around 2min]"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:00.622933 2274 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:00.625108 2274 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:00.628793 2274 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:00.631277 2274 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:00.633001 2274 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:01.903903 2349 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:01.905044 2349 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:01.906314 2349 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:01.907570 2349 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:01.908538 2349 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:03.123325 2370 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:03.124449 2370 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:03.125519 2370 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:03.126643 2370 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:03.127851 2370 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:04.303402 2390 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:04.304467 2390 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:04.305680 2390 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:04.307320 2390 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:04.308776 2390 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:05.573930 2412 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:05.575126 2412 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:05.576982 2412 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:05.578619 2412 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:05.579670 2412 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:06.828943 2432 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:06.830553 2432 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:06.831616 2432 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:06.833713 2432 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:06.834750 2432 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:08.018407 2453 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:08.024692 2453 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:08.025449 2453 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:08.027209 2453 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:08.029007 2453 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:09.277996 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:09.279446 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:09.280774 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:09.281884 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:09.283401 2481 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:10.442449 2569 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:10.443870 2569 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:10.445145 2569 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:10.446784 2569 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:10.448159 2569 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="E0131 11:11:11.658743 3185 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:11.659618 3185 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:11.662135 3185 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:11.663292 3185 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nE0131 11:11:11.664095 3185 memcache.go:265] couldn't get current server API group list: Get \"https://api.crc.testing:6443/api?timeout=32s\": dial tcp 192.168.127.2:6443: connect: connection refused\nThe connection to the server api.crc.testing:6443 was refused - did you specify the right host or port?\n"
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 1\n - sleeping 1s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 12"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 13"
level=debug msg="Running SSH command: timeout 5s oc get nodes --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="NAME STATUS ROLES AGE VERSION\ncrc-ksq4m-master-0 NotReady control-plane,master,worker 21d v1.27.8+4fab27b\n"
level=debug msg="Waiting for availability of resource type 'configmap'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get configmap --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="NAME DATA AGE\nkube-root-ca.crt 1 21d\nopenshift-service-ca.crt 1 21d\n"
level=debug msg="Running SSH command: timeout 30s oc delete -n openshift-machine-config-operator configmap machine-config-controller --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 1, output: "
level=debug msg="Waiting for availability of resource type 'lease'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get lease --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=debug
level=debug msg="Running SSH command: timeout 30s oc delete -A lease --all --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: lease.coordination.k8s.io \"crc-ksq4m-master-0\" deleted\nlease.coordination.k8s.io \"apiserver-5qmh3rbmw7r5gzivxgbio672c4\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-authentication-operator-lock\" deleted\nlease.coordination.k8s.io \"cloud-credential-operator-leader\" deleted\nlease.coordination.k8s.io \"cluster-machine-approver-leader\" deleted\nlease.coordination.k8s.io \"version\" deleted\nlease.coordination.k8s.io \"config-operator-lock\" deleted\nlease.coordination.k8s.io \"console-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"openshift-cluster-etcd-operator-lock\" deleted\nlease.coordination.k8s.io \"openshift-master-controllers\" deleted\nlease.coordination.k8s.io \"kube-apiserver-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-regeneration-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-controller-manager-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"cluster-policy-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-cluster-kube-scheduler-operator-lock\" deleted\nlease.coordination.k8s.io \"cert-recovery-controller-lock\" deleted\nlease.coordination.k8s.io \"kube-scheduler\" deleted\nlease.coordination.k8s.io \"openshift-kube-storage-version-migrator-operator-lock\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-healthcheck-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-libvirt-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-machineset-leader\" deleted\nlease.coordination.k8s.io \"cluster-api-provider-nodelink-leader\" deleted\nlease.coordination.k8s.io \"control-plane-machine-set-leader\" deleted\nlease.coordination.k8s.io \"machine-api-operator\" deleted\nlease.coordination.k8s.io \"machine-config\" deleted\nlease.coordination.k8s.io \"machine-config-controller\" deleted\nlease.coordination.k8s.io \"marketplace-operator-lock\" deleted\nlease.coordination.k8s.io \"ovnkube-identity\" deleted\nlease.coordination.k8s.io \"network-operator-lock\" deleted\nlease.coordination.k8s.io \"packageserver-controller-lock\" deleted\nlease.coordination.k8s.io \"openshift-route-controllers\" deleted\nlease.coordination.k8s.io \"openshift-network-controller\" deleted\nlease.coordination.k8s.io \"service-ca-operator-lock\" deleted\nlease.coordination.k8s.io \"service-ca-controller-lock\" deleted\n"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Adding user's pull secret to the cluster..."
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'machineconfigs'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get machineconfigs --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 19d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 19d\n"
level=debug msg="NAME GENERATEDBYCONTROLLER IGNITIONVERSION AGE\n00-master 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n00-worker 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-master-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-container-runtime 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n01-worker-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n97-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-master-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n98-worker-generated-kubelet 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-master-ssh 3.2.0 21d\n99-node-sizing-for-crc 3.2.0 21d\n99-openshift-machineconfig-master-dummy-networks 3.2.0 21d\n99-worker-generated-registries 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 21d\n99-worker-ssh 3.2.0 21d\nrendered-master-b6464dfb9faffcfa5459a0aeeb2660ac 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 19d\nrendered-worker-81502d3212943f3feb04d6955030592f 7649b9274cde2fb50a61a579e3891c8ead2d79c5 3.4.0 19d\n"
level=debug msg="Running SSH command: timeout 30s oc get machineconfigs 99-master-ssh -o jsonpath='{.spec.config.passwd.users[0].sshAuthorizedKeys[0]}' --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBABT3zAIbFRUQtr8XrXjedhqVzHdaG2ZIIYfQ4vDL+jF0o/yjA0YECbtvgZVFq/6u6jjMn7PdCvfZAgr9tI7Jag95wBvwoeS6Z4sjnt52DPIsqMcQKzKK+VOEcR5M0tbwPVOocRVWRFxQ5K/qMbb84/q18nhhuvHm4v34Lz/65v6MwtMzw== core"
level=info msg="Updating SSH key to machine config resource..."
level=debug msg="Running SSH command: timeout 30s oc patch machineconfig 99-master-ssh -p '{\"spec\": {\"config\": {\"passwd\": {\"users\": [{\"name\": \"core\", \"sshAuthorizedKeys\": [\"ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBADBYePQHJErKTFQTQRcahhJcHR7Vxkpmu9hPozwWANR2tXK8s+mzuIDEO+9Cvae9L4UhzVoSNNXU2q6Dq8QUb6AcgDT/z8LjOiXdoF1qfzye6Xz89+ppzSpK82bXR42oeIO/lnCqdOc1rC+zh9awAplmz1KeIGaifGrNPomuJoq8HHGrA==\"]}]}}}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: machineconfig.machineconfiguration.openshift.io/99-master-ssh patched\n"
level=info msg="Waiting until the user's pull secret is written to the instance disk..."
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 5"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 6"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 7"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 8"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 9"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 10"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 11"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 12"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 13"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 14"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 15"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 16"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 17"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 18"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 19"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 20"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 21"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 22"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 23"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 24"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 25"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 26"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 27"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 28"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 29"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 30"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 31"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 32"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 33"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 34"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 35"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 36"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 37"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 38"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 39"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 40"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 41"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 42"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 43"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 44"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 45"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="error: Temporary error: pull secret not updated to disk - sleeping 2s"
level=debug msg="retry loop: attempt 46"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'secret'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 1"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 2"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 3"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
level=debug
level=debug msg="error: Temporary error: ssh command error:\ncommand : timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig\nerr : Process exited with status 124\n - sleeping 1s"
level=debug msg="retry loop: attempt 4"
level=debug msg="Running SSH command: timeout 5s oc get secret --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="NAME TYPE DATA AGE\nbuilder-dockercfg-5r565 kubernetes.io/dockercfg 1 21d\nbuilder-token-gmcgs kubernetes.io/service-account-token 4 21d\ndefault-dockercfg-ncx4d kubernetes.io/dockercfg 1 21d\ndefault-token-6m87m kubernetes.io/service-account-token 4 21d\ndeployer-dockercfg-t6lqn kubernetes.io/dockercfg 1 21d\ndeployer-token-p6d84 kubernetes.io/service-account-token 4 21d\n"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=info msg="Changing the password for the kubeadmin user"
level=debug msg="Running SSH command: <hidden>"
level=debug msg="SSH command succeeded"
level=debug msg="Waiting for availability of resource type 'clusterversion'"
level=debug msg="retry loop: attempt 0"
level=debug msg="Running SSH command: timeout 5s oc get clusterversion --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="NAME VERSION AVAILABLE PROGRESSING SINCE STATUS\nversion 4.14.8 True False 21d Cluster version is 4.14.8\n"
level=debug msg="Running SSH command: timeout 30s oc get clusterversion version -o jsonpath=\"{['spec']['clusterID']}\" --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: "
level=info msg="Updating cluster ID..."
level=debug msg="Running SSH command: timeout 30s oc patch clusterversion version -p '{\"spec\":{\"clusterID\":\"67c21ad2-67bf-4322-8175-c71ba3755110\"}}' --type merge --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: <nil>, output: clusterversion.config.openshift.io/version patched\n"
level=debug msg="Running SSH command: ls /opt/crc/routes-controller.yaml"
level=debug msg="SSH command results: err: <nil>, output: /opt/crc/routes-controller.yaml\n"
level=debug msg="Running SSH command: timeout 30s oc apply -f /opt/crc/routes-controller.yaml --context admin --cluster crc --kubeconfig /opt/kubeconfig"
level=debug msg="SSH command results: err: Process exited with status 124, output: "
ssh command error:
command : timeout 30s oc apply -f /opt/crc/routes-controller.yaml --context admin --cluster crc --kubeconfig /opt/kubeconfig
err : Process exited with status 124
|