Skip to content

Latest commit

 

History

History
156 lines (118 loc) · 4.34 KB

getting_started.md

File metadata and controls

156 lines (118 loc) · 4.34 KB
Raw

Description

This tutorial shows how to benchmark a simple .NET web application using the bombardier load generation tool.

Installing crank

  1. Install .NET Core.

  2. Install Crank via the following command:

    dotnet tool install -g Microsoft.Crank.Controller --version "0.2.0-*" 

    dotnet tool install -g Microsoft.Crank.Agent --version "0.2.0-*"

  3. Verify the installation was complete by running:

    crank

  4. Ensure git is installed. You can check by running:

git --version

If git is not installed, install git here.

Note: The agent is not required locally to execute a benchmark if it's already installed on a remote server. These steps only assume that you are getting started with crank and that the agent isn't available anywhere else yet.

Define the scenario

The following content is available at https://github.com/dotnet/crank/blob/main/samples/hello/hello.benchmarks.yml

It contains the scenario definitions, describing which applications need to be deployed to run a benchmark.

imports:
    - https://raw.githubusercontent.com/dotnet/crank/main/src/Microsoft.Crank.Jobs.Bombardier/bombardier.yml

jobs:
  server:
    sources:
      crank:
        repository: https://github.com/dotnet/crank
        branchOrCommit: main
    project: crank/samples/hello/hello.csproj

scenarios:
  hello:
    application:
      job: server
    load:
      job: bombardier
      variables:
        serverPort: 5000
        path: /

profiles:
  local:
    variables:
      serverAddress: localhost
    jobs: 
      application:
        endpoints: 
          - http://localhost:5010
      load:
        endpoints: 
          - http://localhost:5010

Start the agent

To run the benchmark at least one agent instance needs to be running. It will run the service named application that will host the web application to benchmark, and the service name load that will host the bombardier load generation.

Ideally, services are deployed on separate machines but for the sake of this tutorial as single agent is used, and both the application and load generation will run locally.

Open a shell and execute these command lines:

> crank-agent
...
Now listening on: http://[::]:5010
...
Agent ready, waiting for jobs...

At that point the agent is ready to accept jobs locally on the port 5010.

Run a scenario using the controller

The scenario definitions file is already created and available.

> crank --config /crank/samples/hello/hello.benchmarks.yml --scenario hello --profile local

[04:19:18.388] Running session 'bb96c510c041416c8fb576160ec12ea0' with description ''
[04:19:18.410] Starting job 'application' ...
[04:19:18.416] Fetching job: http://localhost:5010/jobs/1
[04:19:19.444] Job has been selected by the server ...
[04:19:19.445] Job is now building ...
[04:19:50.624] Job is running
[04:19:50.626] Starting job 'load' ...
[04:19:50.630] Fetching job: http://localhost:5010/jobs/2
[04:19:51.654] Job has been selected by the server ...
[04:19:51.655] Job is now building ...
[04:19:58.748] Job is running
[04:20:06.891] Stopping job 'load' ...
[04:20:07.912] Deleting job 'load' ...
[04:20:07.916] Stopping job 'application' ...
[04:20:09.922] Deleting job 'application' ...

application
-------

## Host Process:
CPU Usage (%):        49
Raw CPU Usage (%):    591.74
Working Set (MB):     152
Build Time (ms):      22,039
Published Size (KB):  86,543

load
-------

## Host Process:
CPU Usage (%):        2
Raw CPU Usage (%):    18.34
Working Set (MB):     31
Build Time (ms):      3,009
Published Size (KB):  68,072

## Benchmark:
Requests:             557,601
Bad responses:        0
Mean latency (us):    2,288
Max latency (us):     556,000
Max RPS:              221,956

Each service deployed (application and load) have reported their metrics, including the Requests Per Second.

Note: The agent and controller can also be executed directly from source if dotnet tools can't be installed.

Windows Defender notifications

On Windows you'll get a popup alert every time an app is started. To discard these follow these steps:

  • Open the Windows Security application from the Start menu
  • Click on Settings at the bottom left
  • Turn the firewall notifications off