Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

caliper benchmarks that use fixed-load specify the start tps using startingTps but it should be startTps #231

Open
davidkel opened this issue Sep 6, 2022 · 0 comments
Labels
bug Something isn't working good first issue Good for newcomers

Comments

@davidkel
Copy link
Contributor

davidkel commented Sep 6, 2022

This means it always starts at 5 and if I have a system that is able to process lots of TPS eg start at 1000 (but really 5) with a max unfinished of 15000 you get

2022.09.06-10:39:48.356 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:39:53.343 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:39:58.346 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:40:03.346 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:40:08.343 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:40:13.344 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 0 Succ: 0 Fail:0 Unfinished:0
2022.09.06-10:40:18.350 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:23.345 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:28.347 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:33.349 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:38.350 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:43.353 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 150 Succ: 150 Fail:0 Unfinished:0
2022.09.06-10:40:48.345 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 23502 Succ: 7023 Fail:2052 Unfinished:14427
2022.09.06-10:40:53.346 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 33685 Succ: 12079 Fail:9068 Unfinished:12538
2022.09.06-10:40:58.351 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 44652 Succ: 16753 Fail:16659 Unfinished:11240
2022.09.06-10:41:03.353 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 54078 Succ: 21522 Fail:23823 Unfinished:8733
2022.09.06-10:41:08.351 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 69104 Succ: 26514 Fail:31002 Unfinished:11588
2022.09.06-10:41:13.350 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 84318 Succ: 31867 Fail:37857 Unfinished:14594
2022.09.06-10:41:18.360 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 87101 Succ: 37737 Fail:45088 Unfinished:4276

As it appears to take a while to distribute the tps across all the workers (I had 150 workers) so it doesn't submit anything for a while until the rate controller pops which initially was 30 seconds

1000 / (5/150) = 150000/5 = 30,000 ms

@davidkel davidkel added bug Something isn't working good first issue Good for newcomers labels Oct 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant