This project was developed as a final work for the Performance Evaluation Modeling discipline at University of Fortaleza, as a way to get to know and gain practical experience in the use of a benchmark widely known in the market.
That way we were asked to do some load tests with four framework among 12 listed on this article:https://k6.io/blog/comparing-best-open-source-load-testing-tools/. As a target service of the load tests, we choosed httpbin service, available at https://httpbin.org/ (online) and https://github.com/postmanlabs/httpbin (source code).
The frameworks that we used was:
- Apachebench
- Vegeta
- Locust
- Artillery
At first, the tests used the following parameters:
- Duration: 60 seconds
- Users: 10 and 100 users
- Load: 10 and 100 users/s*
Note: the load may not be 10 or 100 u/s, since each platform defines its way of generating load.
After that, the performance of the target system was monitored with Prometheus, then Prometheus was integrated with Grafana, in order to allow the visualization, in real time, of the httpbin metrics being collected by Prometheus during the load tests.
Although, Gunicorn (WSGI Server used by HTTPBin) has native integration with StatsD-Exporte it was necessary to modify the dockerfile to configure the command used to run the application. In this way, Gunicorn feeds StatsD data from Gunicorn, which in turn is consumed by Prometheus.
All necessary files were created from Docker images via DockerHub, with the exception of HTTPBin which had its image built from local dockerfile.
Public images used:
- graphane/grafane
- prom/prometheus
- prom/statsd-exporter
Note: To run, you have to install
DockerandDocker Compose.
In order to replicated what was done you have to:
- Download httpbin code
- Modify dockerfile to configure the command used to run the application
- Clone this project with:
git clone https://github.com/alicemalzac/loadtest
- And run, with the command below:
docker-compose up --build
After that, you can access these services:
- Grafana: http://localhost:3000
- Prometheus: http://localhost:9090
- HttpBin: http://localhost:8080
- Statsd: http://localhost:9102/metrics
- NodeExporter: http://localhost:9110
- cAdvisor: http://localhost:8090
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.