You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There is an issue with established connections to the remote Kubernetes API on Virtual Kubelet. After stopping port-forwarding to a pod running on the virtual node, the connection to the remote Kubernetes API remains active.
What you expected to happen:
The connection to the remote Kubernetes API should be terminated after port-forwarding is completed.
How to reproduce it (as minimally and precisely as possible):
This pod is deployed on virtual node:
apiVersion: v1
kind: Pod
metadata:
name: vk-pf-test
namespace: default
spec:
containers:
After that we can see that amount of connections from 3.1 command grows, and, even when port-forwarding is dropped, amount of connections is still the same.
This behaviour overloads NAT which is in the middle of virtual-kubelet and remote Kubernetes api server and, also, with lots of ESTABLISHED connections to remote Kubernetes api virtual-kubelet pod memory consumption also grows, and causes OOM issues.
What happened:
There is an issue with established connections to the remote Kubernetes API on Virtual Kubelet. After stopping port-forwarding to a pod running on the virtual node, the connection to the remote Kubernetes API remains active.
What you expected to happen:
The connection to the remote Kubernetes API should be terminated after port-forwarding is completed.
How to reproduce it (as minimally and precisely as possible):
apiVersion: v1
kind: Pod
metadata:
name: vk-pf-test
namespace: default
spec:
containers:
image: nginx:1.14.2
ports:
kubectl port-forward vk-pf-test 8080:80 -n default
3.1. Inside virtual kubelet pod:
watch "netstat -an |grep 'remote_kube_api_ip' |grep ESTABLISHED |wc -l"
3.2. Execute several times from local shell:
curl http://127.0.0.1:8080/
After that we can see that amount of connections from 3.1 command grows, and, even when port-forwarding is dropped, amount of connections is still the same.
This behaviour overloads NAT which is in the middle of virtual-kubelet and remote Kubernetes api server and, also, with lots of ESTABLISHED connections to remote Kubernetes api virtual-kubelet pod memory consumption also grows, and causes OOM issues.
Environment:
kubectl version
): v1.29.5-gke.1060000The text was updated successfully, but these errors were encountered: