Skip to content

Latest commit

 

History

History
261 lines (186 loc) · 6.75 KB

CommonIssues.md

File metadata and controls

261 lines (186 loc) · 6.75 KB
Raw

Common issues

New version of azure cli does not work with az aks browse or aks get credentials

'ManagedCluster' object has no attribute 'properties'

Downgrade azure cli to working version

WORKING_VERSION=2.0.23-1
sudo apt-get install azure-cli=$WORKING_VERSION

Get latest supported version

LOCATION='westeurope'
az aks get-versions -l $LOCATION --query "orchestrators[?default == `true` && isPreview == `null`].orchestratorVersion" --output tsv

az aks get-versions -l $LOCATION --query 'orchestrators[?default == `true`].orchestratorVersion' -o tsv

Edit using NANO

KUBE_EDITOR="nano" kubectl edit svc/nginxpod-service

KUBE_EDITOR="nano" kubectl -n kube-system edit cm kube-proxy

export KUBE_EDITOR='code --wait'
kubectl edit deployment dummy -n dnamespace

NIC in failed state

reset nic via cli

az network nic update -g MC_* -n aks-nodepool1-*-nic-0

Check if your cluster has RBAC

kubectl cluster-info dump --namespace kube-system | grep authorization-mode

Get Image Version of nodes


az aks nodepool get-upgrades --nodepool-name default --cluster-name $KUBE_NAME --resource-group $KUBE_GROUP -o table

az aks get-upgrades --resource-group $KUBE_GROUP --name $KUBE_NAME --output table

kubectl get nodes -o jsonpath='{range .items[*]}{.metadata.name}{"\t"}{.metadata.labels.kubernetes\.azure\.com\/node-image-version}{"\n"}{end}'

az aks upgrade --resource-group $KUBE_GROUP --name $KUBE_NAME --node-image-only

Find out source ip

curl ipinfo.io/ip

kubectl run azure-function-on-kubernetes --image=denniszielke/az-functions --port=80 --requests=cpu=100m

kubectl expose deployment azure-function-on-kubernetes --type=LoadBalancer

kubectl autoscale deploy azure-function-on-kubernetes --cpu-percent=20 --max=10 --min=1

apk add --update curl
export num=0 && while true; do curl -s -w "$num = %{time_namelookup}" "time nslookup google.com"; echo ""; num=$((num+1)); done

kubectl run alp --image=alpine:3.6

kubectl run alp --image=quay.io/collectai/alpine-curl

docker run --rm jess/curl -sSL ipinfo.io/ip

while true; do kubectl get pod -A -o wide ; done

Steps how to attach public IP to a worker node

find out the resource group that AKS created for the node VMs

az group list -o table

list resources in the group and find the VM you want to access

az resource list -g MC_kubernetes_kubernetes-cluster_ukwest -o table

show parameters of that VM, see for example: "adminUsername": "azureuser"

az vm show -g aks-default-10832236-0 -n aks-default-10832236-0

create the public IP

az network public-ip create -g MC_kub_ter_k_m_iuasdf_iuasdf_westeurope -n test-ip

find out correct NIC where to add the public IP

az network nic list -g MC_kub_ter_k_m_iuasdf_iuasdf_westeurope -o table

find out the name of the ipconfig within that NIC

az network nic ip-config list --nic-name aks-default-10832236-nic-0 -g MC_kub_ter_k_m_iuasdf_iuasdf_westeurope

modify the ipconfig by adding the public IP address

az network nic ip-config update -g MC_kub_ter_k_m_iuasdf_iuasdf_westeurope --nic-name aks-default-10832236-nic-0 --name ipconfig1 --public-ip-address test-ip

find out what the allocated public IP address is

az network public-ip show -g MC_kubernetes_kubernetes-cluster_ukwest -n test-ip

then finally connect with SSH

ssh azureuser@<public ip address>

delete containers

kubectl delete pod -n kube-system --selector "component=kube-proxy"

enumerate all service principals for all clusters

az aks list --query '[].{Name:name, ClientId:servicePrincipalProfile.clientId, MsiId:identity.principalId}' -o table

kubectl patch deployment myapp-deployment -p
'{"spec":{"template":{"spec":{"containers":[{"name":"myapp","image":"172.20.34.206:5000/myapp:img:3.0"}]}}}}'

kubectl patch deployment myapp-deployment -p
'{"spec":{"template":{"spec":{"tolerations":[{"key":"expensive","operator":"Equal","value":"true","effect":"NoSchedule"}]}}}}'

cat <<EOF | kubectl apply -f -
kind: Pod
apiVersion: v1
metadata:
  name: curl
spec:
  containers:
    - name: curl
      image: jess/curl
      args: ["-sSL", "ipinfo.io/ip"]
EOF

kubectl logs curl

kubectl exec runclient -- bash -c "date &&
echo 1 &&
echo 2"

kubectl exec alpclient -- bash -c "var=1 &&
while true ; do &&
res=$( { curl -o /dev/null -s -w %{time_namelookup}\\n http://www.google.com; } 2>&1 ) &&
var=$((var+1)) &&
if [[ $res =~ ^[1-9] ]]; then &&
now=$(date +'%T') &&
echo '$var slow: $res $now' &&
break &&
fi &&
done"

kubectl get pods |grep runclient|cut -f1 -d\ |
while read pod;
do echo "$pod writing:";
kubectl exec -t $pod -- bash -c
var=1
while true ; do
res=$( { curl -o /dev/null -s -w %{time_namelookup}\n http://www.google.com; } 2>&1 )
var=$((var+1))
if [[ $res =~ ^[1-9] ]]; then
now=$(date +"%T")
echo "$var slow: $res $now"
break
fi
done
done

var=1; while true ; do res=$( { curl -o /dev/null -s -w %{time_namelookup}\n http://nginx; } 2>&1 ) var=$((var+1)) now=$(date +"%T") echo "$var slow: $res $now" if [[ $res =~ ^[1-9] ]]; then now=$(date +"%T") echo "$var slow: $res $now" break fi done

var=1; while true ; do res=$( { curl -o /dev/null -s -w %{time_namelookup}\n http://www.google.com; } 2>&1 ) var=$((var+1)) now=$(date +"%T") echo "$var slow: $res $now" done

for i in seq 1 1000; do time curl -s google.com > /dev/null; done

kubectl run -i --tty busybox --image=busybox --restart=Never -- sh

scp /path/to/file username@a:/path/to/destination

scp username@b:/path/to/file /path/to/destination

scp dennis@40.114.247.218:/var/log/azure/cluster-provision.log cluster-provision.log scp dennis@40.114.247.218:/var/log/cloud-init-output.log cloud-init-output.log scp ~/.ssh/id_rsa dennis@dz-acs.westeurope.cloudapp.azure.com:/.ssh

chmod 400 ~/.ssh/id_rsa ssh dennis@10.240.0.4 -i ~/.ssh/id_rsa

CLUSTER_RESOURCE_GROUP=$(az aks show --resource-group security --name slbrouter --query nodeResourceGroup -o tsv)

az vmss extension set
--resource-group $CLUSTER_RESOURCE_GROUP
--vmss-name $SCALE_SET_NAME
--name VMAccessForLinux
--publisher Microsoft.OSTCExtensions
--version 1.4
--protected-settings "{"username":"dennis", "ssh_key":"$(cat ~/.ssh/id_rsa.pub)"}"

cat <<EOF | kubectl apply -f - apiVersion: v1 kind: Pod metadata: name: centos spec: containers:

  • name: centoss image: centos ports:
    • containerPort: 80 command:
    • sleep
    • "3600" EOF

cat <<EOF | kubectl apply -f - apiVersion: v1 kind: Pod metadata: name: debian spec: containers:

  • name: debian image: debian ports:
    • containerPort: 80 command:
    • sleep
    • "3600" EOF

kubectl get events --sort-by='{.lastTimestamp}'