Fix: Correct num_requests in benchmark for Pipeline Parallel Serving … #6723
Job | Run time |
---|---|
1s | |
2s | |
2s | |
6s | |
3s | |
5s | |
4s | |
1m 0s | |
2m 26s | |
53s | |
1m 23s | |
2m 35s | |
1m 14s | |
28m 3s | |
13m 10s | |
23m 10s | |
15m 3s | |
1h 29m 20s |
Job | Run time |
---|---|
1s | |
2s | |
2s | |
6s | |
3s | |
5s | |
4s | |
1m 0s | |
2m 26s | |
53s | |
1m 23s | |
2m 35s | |
1m 14s | |
28m 3s | |
13m 10s | |
23m 10s | |
15m 3s | |
1h 29m 20s |