removing-server

Removing a server

In this recipe we'll learn how to remove a server from a Pinot cluster.

Pinot Version	1.0.0
Schema	Schema and Table Config

This is the code for the following recipe: https://dev.startree.ai/docs/pinot/recipes/removing-server

---

git clone git@github.com:startreedata/pinot-recipes.git
cd pinot-recipes/recipes/removing-server

Create Kubernetes cluster

kind create cluster

Spin up a Pinot cluster using Kubernetes

helm repo add pinot https://raw.githubusercontent.com/apache/pinot/master/kubernetes/helm
kubectl create ns pinot-quickstart
helm install pinot pinot/pinot \
    -n pinot-quickstart \
    --set cluster.name=pinot \
    --set server.replicaCount=4

Add tables and schema:

kubectl apply -f config/pinot-events.yml

Port Forward Pinot UI on port 9000

kubectl port-forward service/pinot-controller 9000:9000 -n pinot-quickstart

Start Kafka cluster

helm repo add kafka https://charts.bitnami.com/bitnami
helm install -n pinot-quickstart kafka kafka/kafka --set replicas=1,zookeeper.image.tag=latest

Port forward Kafka on port 9090 Add the following line to /etc/hosts

127.0.0.1 kafka-0.kafka-headless.pinot-quickstart.svc.cluster.local

Ingest data into Kafka

python datagen.py --sleep 0.0001 2>/dev/null |
jq -cr --arg sep ø '[.uuid, tostring] | join($sep)' |
kcat -P -b localhost:9092 -t events -Kø

Install script dependencies + run script

pip install click ordered-set requests
python segments_to_server.py

Remove server

kubectl scale statefulset.apps/pinot-server -n pinot-quickstart --replicas=3

Remove tags from the removed server

curl -X PUT \
  "http://localhost:9000/instances/Server_pinot-server-3.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098/updateTags?tags=&updateBrokerResource=false" \
  -H "accept: application/json"

Rebalance segments

python rebalance.py

Remove instance

curl -X DELETE \
  "http://localhost:9000/instances/Server_pinot-server-3.pinot-server-headless.pinot-quickstart.svc.cluster.local_8098" \
  -H "accept: application/json"