This folder has Docker Compose and Kubernetes configurations to run the TFServing agent together with a TFServing model, Prometheus and Grafana.
Docker Compose may already be present if you are using a desktop Docker installation. Else see here.
kubectl should be present for command-line commands against Kubernetes clusters.
Kubernetes configs have been tested against GKE only.
From the docker-compose subdirectory,
docker compose upThis serves a HTTP API on localhost:8551 by default, with a Grafana instance exposed on localhost:3000.
With kubectl configured to access a cluster, run
kubectl apply -f petfinder_k8s.yaml
kubectl apply -f monitoring_k8s.yaml --namespace=monitoring