-
Notifications
You must be signed in to change notification settings - Fork 293
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix test name uniqueness #8018
Merged
Merged
Fix test name uniqueness #8018
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
PerfectSlayer
added
comp: testing
Testing
tag: no release notes
Changes to exclude from release notes
labels
Nov 26, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090816
Total [baseline] (8.662 s) : 0, 8661553
Agent [candidate] (1.087 s) : 0, 1087452
Total [candidate] (8.657 s) : 0, 8657497
section iast
Agent [baseline] (1.216 s) : 0, 1216136
Total [baseline] (9.203 s) : 0, 9202860
Agent [candidate] (1.222 s) : 0, 1221895
Total [candidate] (9.209 s) : 0, 9209138
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.219 s) : 0, 1218902
Total [baseline] (9.167 s) : 0, 9166849
Agent [candidate] (1.227 s) : 0, 1227164
Total [candidate] (9.193 s) : 0, 9193480
section iast_TELEMETRY_OFF
Agent [baseline] (1.222 s) : 0, 1222399
Total [baseline] (9.216 s) : 0, 9216337
Agent [candidate] (1.218 s) : 0, 1218343
Total [candidate] (9.2 s) : 0, 9200412
gantt
title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (693.701 ms) : 0, 693701
BytebuddyAgent [candidate] (693.204 ms) : 0, 693204
GlobalTracer [baseline] (317.452 ms) : 0, 317452
GlobalTracer [candidate] (317.315 ms) : 0, 317315
AppSec [baseline] (54.643 ms) : 0, 54643
AppSec [candidate] (54.776 ms) : 0, 54776
Remote Config [baseline] (679.358 µs) : 0, 679
Remote Config [candidate] (674.325 µs) : 0, 674
Telemetry [baseline] (10.676 ms) : 0, 10676
Telemetry [candidate] (7.787 ms) : 0, 7787
section iast
BytebuddyAgent [baseline] (810.601 ms) : 0, 810601
BytebuddyAgent [candidate] (816.073 ms) : 0, 816073
GlobalTracer [baseline] (305.44 ms) : 0, 305440
GlobalTracer [candidate] (305.538 ms) : 0, 305538
AppSec [baseline] (57.528 ms) : 0, 57528
AppSec [candidate] (57.796 ms) : 0, 57796
IAST [baseline] (20.748 ms) : 0, 20748
IAST [candidate] (20.575 ms) : 0, 20575
Remote Config [baseline] (612.396 µs) : 0, 612
Remote Config [candidate] (648.164 µs) : 0, 648
Telemetry [baseline] (7.509 ms) : 0, 7509
Telemetry [candidate] (7.446 ms) : 0, 7446
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (812.112 ms) : 0, 812112
BytebuddyAgent [candidate] (817.097 ms) : 0, 817097
GlobalTracer [baseline] (306.4 ms) : 0, 306400
GlobalTracer [candidate] (308.521 ms) : 0, 308521
AppSec [baseline] (56.321 ms) : 0, 56321
AppSec [candidate] (57.68 ms) : 0, 57680
IAST [baseline] (22.346 ms) : 0, 22346
IAST [candidate] (21.892 ms) : 0, 21892
Remote Config [baseline] (614.551 µs) : 0, 615
Remote Config [candidate] (628.95 µs) : 0, 629
Telemetry [baseline] (7.452 ms) : 0, 7452
Telemetry [candidate] (7.631 ms) : 0, 7631
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (813.992 ms) : 0, 813992
BytebuddyAgent [candidate] (812.743 ms) : 0, 812743
GlobalTracer [baseline] (307.677 ms) : 0, 307677
GlobalTracer [candidate] (305.612 ms) : 0, 305612
AppSec [baseline] (57.3 ms) : 0, 57300
AppSec [candidate] (57.201 ms) : 0, 57201
IAST [baseline] (21.587 ms) : 0, 21587
IAST [candidate] (21.077 ms) : 0, 21077
Remote Config [baseline] (649.599 µs) : 0, 650
Remote Config [candidate] (612.813 µs) : 0, 613
Telemetry [baseline] (7.468 ms) : 0, 7468
Telemetry [candidate] (7.336 ms) : 0, 7336
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.096 s) : 0, 1096401
Total [baseline] (10.416 s) : 0, 10416496
Agent [candidate] (1.089 s) : 0, 1089498
Total [candidate] (10.445 s) : 0, 10445401
section appsec
Agent [baseline] (1.228 s) : 0, 1228416
Total [baseline] (10.737 s) : 0, 10737156
Agent [candidate] (1.234 s) : 0, 1233988
Total [candidate] (10.793 s) : 0, 10793159
section iast
Agent [baseline] (1.215 s) : 0, 1215381
Total [baseline] (10.948 s) : 0, 10947723
Agent [candidate] (1.219 s) : 0, 1218795
Total [candidate] (10.958 s) : 0, 10957995
section profiling
Agent [baseline] (1.316 s) : 0, 1316098
Total [baseline] (10.826 s) : 0, 10826058
Agent [candidate] (1.312 s) : 0, 1312377
Total [candidate] (10.849 s) : 0, 10848666
gantt
title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (697.952 ms) : 0, 697952
BytebuddyAgent [candidate] (693.089 ms) : 0, 693089
GlobalTracer [baseline] (318.726 ms) : 0, 318726
GlobalTracer [candidate] (317.308 ms) : 0, 317308
AppSec [baseline] (54.689 ms) : 0, 54689
AppSec [candidate] (54.727 ms) : 0, 54727
Remote Config [baseline] (680.129 µs) : 0, 680
Remote Config [candidate] (685.803 µs) : 0, 686
Telemetry [baseline] (10.588 ms) : 0, 10588
Telemetry [candidate] (9.973 ms) : 0, 9973
section appsec
BytebuddyAgent [baseline] (713.548 ms) : 0, 713548
BytebuddyAgent [candidate] (717.303 ms) : 0, 717303
GlobalTracer [baseline] (315.226 ms) : 0, 315226
GlobalTracer [candidate] (316.373 ms) : 0, 316373
AppSec [baseline] (167.296 ms) : 0, 167296
AppSec [candidate] (167.329 ms) : 0, 167329
IAST [baseline] (20.428 ms) : 0, 20428
IAST [candidate] (19.258 ms) : 0, 19258
Remote Config [baseline] (637.959 µs) : 0, 638
Remote Config [candidate] (644.92 µs) : 0, 645
Telemetry [baseline] (7.736 ms) : 0, 7736
Telemetry [candidate] (8.937 ms) : 0, 8937
section iast
BytebuddyAgent [baseline] (809.251 ms) : 0, 809251
BytebuddyAgent [candidate] (811.818 ms) : 0, 811818
GlobalTracer [baseline] (305.824 ms) : 0, 305824
GlobalTracer [candidate] (306.378 ms) : 0, 306378
AppSec [baseline] (57.697 ms) : 0, 57697
AppSec [candidate] (56.833 ms) : 0, 56833
IAST [baseline] (20.777 ms) : 0, 20777
IAST [candidate] (21.851 ms) : 0, 21851
Remote Config [baseline] (617.072 µs) : 0, 617
Remote Config [candidate] (633.522 µs) : 0, 634
Telemetry [baseline] (7.527 ms) : 0, 7527
Telemetry [candidate] (7.564 ms) : 0, 7564
section profiling
BytebuddyAgent [baseline] (688.279 ms) : 0, 688279
BytebuddyAgent [candidate] (686.738 ms) : 0, 686738
GlobalTracer [baseline] (434.535 ms) : 0, 434535
GlobalTracer [candidate] (431.411 ms) : 0, 431411
AppSec [baseline] (53.527 ms) : 0, 53527
AppSec [candidate] (53.551 ms) : 0, 53551
Remote Config [baseline] (652.215 µs) : 0, 652
Remote Config [candidate] (658.434 µs) : 0, 658
Telemetry [baseline] (7.707 ms) : 0, 7707
Telemetry [candidate] (7.699 ms) : 0, 7699
ProfilingAgent [baseline] (92.518 ms) : 0, 92518
ProfilingAgent [candidate] (93.361 ms) : 0, 93361
Profiling [baseline] (92.542 ms) : 0, 92542
Profiling [candidate] (93.385 ms) : 0, 93385
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section baseline
no_agent (1.358 ms) : 1339, 1378
. : milestone, 1358,
appsec (1.766 ms) : 1741, 1791
. : milestone, 1766,
appsec_no_iast (1.756 ms) : 1732, 1780
. : milestone, 1756,
iast (1.516 ms) : 1494, 1538
. : milestone, 1516,
profiling (1.518 ms) : 1494, 1541
. : milestone, 1518,
tracing (1.489 ms) : 1464, 1514
. : milestone, 1489,
section candidate
no_agent (1.354 ms) : 1333, 1374
. : milestone, 1354,
appsec (1.761 ms) : 1737, 1785
. : milestone, 1761,
appsec_no_iast (1.788 ms) : 1763, 1813
. : milestone, 1788,
iast (1.508 ms) : 1485, 1531
. : milestone, 1508,
profiling (1.55 ms) : 1525, 1574
. : milestone, 1550,
tracing (1.491 ms) : 1466, 1516
. : milestone, 1491,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section baseline
no_agent (373.731 µs) : 354, 393
. : milestone, 374,
iast (497.348 µs) : 476, 519
. : milestone, 497,
iast_FULL (657.947 µs) : 636, 680
. : milestone, 658,
iast_GLOBAL (523.351 µs) : 502, 545
. : milestone, 523,
iast_HARDCODED_SECRET_DISABLED (497.799 µs) : 476, 519
. : milestone, 498,
iast_INACTIVE (456.477 µs) : 436, 477
. : milestone, 456,
iast_TELEMETRY_OFF (489.178 µs) : 468, 511
. : milestone, 489,
tracing (457.546 µs) : 436, 479
. : milestone, 458,
section candidate
no_agent (376.433 µs) : 356, 397
. : milestone, 376,
iast (503.56 µs) : 482, 525
. : milestone, 504,
iast_FULL (658.679 µs) : 637, 680
. : milestone, 659,
iast_GLOBAL (525.235 µs) : 503, 547
. : milestone, 525,
iast_HARDCODED_SECRET_DISABLED (496.019 µs) : 474, 518
. : milestone, 496,
iast_INACTIVE (455.233 µs) : 434, 477
. : milestone, 455,
iast_TELEMETRY_OFF (486.38 µs) : 465, 508
. : milestone, 486,
tracing (454.096 µs) : 433, 475
. : milestone, 454,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
. : milestone, 1477,
appsec (2.621 ms) : 2554, 2689
. : milestone, 2621,
iast (2.399 ms) : 2316, 2483
. : milestone, 2399,
iast_GLOBAL (2.445 ms) : 2361, 2529
. : milestone, 2445,
profiling (2.231 ms) : 2162, 2301
. : milestone, 2231,
tracing (2.21 ms) : 2143, 2278
. : milestone, 2210,
section candidate
no_agent (1.481 ms) : 1470, 1493
. : milestone, 1481,
appsec (2.631 ms) : 2563, 2699
. : milestone, 2631,
iast (2.396 ms) : 2313, 2479
. : milestone, 2396,
iast_GLOBAL (2.437 ms) : 2354, 2521
. : milestone, 2437,
profiling (2.264 ms) : 2193, 2336
. : milestone, 2264,
tracing (2.213 ms) : 2146, 2281
. : milestone, 2213,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~0c32a79f1d, baseline=1.44.0-SNAPSHOT~92e8023155
dateFormat X
axisFormat %s
section baseline
no_agent (14.792 s) : 14792000, 14792000
. : milestone, 14792000,
appsec (14.835 s) : 14835000, 14835000
. : milestone, 14835000,
iast (18.32 s) : 18320000, 18320000
. : milestone, 18320000,
iast_GLOBAL (18.92 s) : 18920000, 18920000
. : milestone, 18920000,
profiling (14.478 s) : 14478000, 14478000
. : milestone, 14478000,
tracing (14.679 s) : 14679000, 14679000
. : milestone, 14679000,
section candidate
no_agent (14.566 s) : 14566000, 14566000
. : milestone, 14566000,
appsec (14.56 s) : 14560000, 14560000
. : milestone, 14560000,
iast (18.223 s) : 18223000, 18223000
. : milestone, 18223000,
iast_GLOBAL (17.081 s) : 17081000, 17081000
. : milestone, 17081000,
profiling (14.395 s) : 14395000, 14395000
. : milestone, 14395000,
tracing (14.615 s) : 14615000, 14615000
. : milestone, 14615000,
|
smola
approved these changes
Nov 26, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR fixes test name uniqueness.
Motivation
This will help with CI monitoring to keep track of test execution.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]