Tutorial 4: Verify that your monitoring stack has been correctly configured #158

nyameko · 2024-07-11T05:03:13Z

nyameko
Jul 11, 2024
Maintainer

Post screenshots of your outputs similar to the following:

$ sudo docker compose up -d
[+] Running 4/4
✔ Network monitoring_stack_monitoring-network Created 0.3s
✔ Container monitoring_stack-grafana-1 Started 0.2s
✔ Container monitoring_stack-prometheus-1 Started 0.3s
✔ Container monitoring_stack-node-exporter-1 Started 0.2s

And

sudo docker ps
CONTAINER ID   IMAGE                COMMAND                  CREATED      STATUS        PORTS                                       NAMES
2b707570dc41   grafana/grafana      "/run.sh"                6 days ago   Up 12 hours   0.0.0.0:3000->3000/tcp, :::3000->3000/tcp   monitoring_stack-grafana-1
ea730ef94381   prom/prometheus      "/bin/prometheus --c…"   6 days ago   Up 10 hours   0.0.0.0:9090->9090/tcp, :::9090->9090/tcp   monitoring_stack-prometheus-1
704dfa94ecf3   prom/node-exporter   "/bin/node_exporter"     6 days ago   Up 12 hours   0.0.0.0:9100->9100/tcp, :::9100->9100/tcp   monitoring_stack-node-exporter-1

Dump database output from Prometheus, Node-Exporter and Grafana:

$ curl -s localhost:9090/metrics | head
# HELP go_gc_cycles_automatic_gc_cycles_total Count of completed GC cycles generated by the Go runtime.
# TYPE go_gc_cycles_automatic_gc_cycles_total counter
go_gc_cycles_automatic_gc_cycles_total 5
# HELP go_gc_cycles_forced_gc_cycles_total Count of completed GC cycles forced by the application.
# TYPE go_gc_cycles_forced_gc_cycles_total counter
go_gc_cycles_forced_gc_cycles_total 0
# HELP go_gc_cycles_total_gc_cycles_total Count of all completed GC cycles.
# TYPE go_gc_cycles_total_gc_cycles_total counter
go_gc_cycles_total_gc_cycles_total 5
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 7.81e-05
go_gc_duration_seconds{quantile="0.25"} 0.000135
...

$ curl -s localhost:9100/metrics | head
# HELP go_gc_duration_seconds A summary of the pause duration of
garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 2.1937e-05
go_gc_duration_seconds{quantile="0.25"} 3.2322e-05
go_gc_duration_seconds{quantile="0.5"} 3.4946e-05
go_gc_duration_seconds{quantile="0.75"} 5.7424e-05
go_gc_duration_seconds{quantile="1"} 0.000171199
go_gc_duration_seconds_sum 0.007451006
go_gc_duration_seconds_count 157
# HELP go_goroutines Number of goroutines that currently exist

$ curl -s localhost:3000 | hea
<a href=“/login">Found</a>.
$ curl -s -u admin:admin localhost:3000 | head
<!DOCTYPE html>
<html lang="en-US">
<head>
<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" />
<meta name="viewport" content="width=device-width" />
<meta name="theme-color" content="#000" />
<title>Grafana</title>