Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393 #8182

Closed
wants to merge 2 commits into from
Closed

Update system-tests to a7eed9cec4b13c700797be1deb3af0ba2f989393 #8182

wants to merge 2 commits into from
+1 −1

Conversation

smola
Copy link
Member

@smola smola commented Jan 13, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@smola smola added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Jan 13, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jan 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20250113
git_commit_date 1736758880 1736777579
git_commit_sha 8bcee06 bb50ea5
release_version 1.46.0-SNAPSHOT~8bcee06789 1.46.0-SNAPSHOT~bb50ea5ee9
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736779925 1736779925
ci_job_id 763810424 763810424
ci_pipeline_id 52818476 52818476
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053221
Total [baseline] (8.62 s) : 0, 8620180
Agent [candidate] (1.062 s) : 0, 1062144
Total [candidate] (8.649 s) : 0, 8648977
section iast
Agent [baseline] (1.187 s) : 0, 1187470
Total [baseline] (9.209 s) : 0, 9209073
Agent [candidate] (1.185 s) : 0, 1184799
Total [candidate] (9.211 s) : 0, 9211199
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.185 s) : 0, 1185216
Total [baseline] (9.179 s) : 0, 9179259
Agent [candidate] (1.19 s) : 0, 1190343
Total [candidate] (9.156 s) : 0, 9156165
section iast_TELEMETRY_OFF
Agent [baseline] (1.174 s) : 0, 1174043
Total [baseline] (9.159 s) : 0, 9158960
Agent [candidate] (1.176 s) : 0, 1176098
Total [candidate] (9.225 s) : 0, 9224635
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.187 s 134.248 ms (12.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.185 s 131.995 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.174 s 120.822 ms (11.5%)
Total tracing 8.62 s -
Total iast 9.209 s 588.893 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.179 s 559.079 ms (6.5%)
Total iast_TELEMETRY_OFF 9.159 s 538.78 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.185 s 122.655 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.19 s 128.199 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.176 s 113.954 ms (10.7%)
Total tracing 8.649 s -
Total iast 9.211 s 562.223 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.156 s 507.188 ms (5.9%)
Total iast_TELEMETRY_OFF 9.225 s 575.659 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (711.51 ms) : 0, 711510
BytebuddyAgent [candidate] (718.31 ms) : 0, 718310
GlobalTracer [baseline] (254.772 ms) : 0, 254772
GlobalTracer [candidate] (258.285 ms) : 0, 258285
AppSec [baseline] (55.915 ms) : 0, 55915
AppSec [candidate] (55.834 ms) : 0, 55834
Remote Config [baseline] (717.72 µs) : 0, 718
Remote Config [candidate] (736.983 µs) : 0, 737
Telemetry [baseline] (15.33 ms) : 0, 15330
Telemetry [candidate] (13.909 ms) : 0, 13909
section iast
BytebuddyAgent [baseline] (834.488 ms) : 0, 834488
BytebuddyAgent [candidate] (833.343 ms) : 0, 833343
GlobalTracer [baseline] (247.821 ms) : 0, 247821
GlobalTracer [candidate] (247.377 ms) : 0, 247377
AppSec [baseline] (58.691 ms) : 0, 58691
AppSec [candidate] (58.214 ms) : 0, 58214
IAST [baseline] (21.809 ms) : 0, 21809
IAST [candidate] (21.371 ms) : 0, 21371
Remote Config [baseline] (697.615 µs) : 0, 698
Remote Config [candidate] (677.256 µs) : 0, 677
Telemetry [baseline] (8.986 ms) : 0, 8986
Telemetry [candidate] (8.759 ms) : 0, 8759
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.802 ms) : 0, 834802
BytebuddyAgent [candidate] (833.713 ms) : 0, 833713
GlobalTracer [baseline] (245.94 ms) : 0, 245940
GlobalTracer [candidate] (250.933 ms) : 0, 250933
AppSec [baseline] (58.414 ms) : 0, 58414
AppSec [candidate] (58.964 ms) : 0, 58964
IAST [baseline] (21.493 ms) : 0, 21493
IAST [candidate] (21.988 ms) : 0, 21988
Remote Config [baseline] (669.974 µs) : 0, 670
Remote Config [candidate] (691.259 µs) : 0, 691
Telemetry [baseline] (8.875 ms) : 0, 8875
Telemetry [candidate] (9.01 ms) : 0, 9010
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (826.07 ms) : 0, 826070
BytebuddyAgent [candidate] (826.659 ms) : 0, 826659
GlobalTracer [baseline] (245.96 ms) : 0, 245960
GlobalTracer [candidate] (246.867 ms) : 0, 246867
AppSec [baseline] (57.319 ms) : 0, 57319
AppSec [candidate] (57.575 ms) : 0, 57575
IAST [baseline] (20.569 ms) : 0, 20569
IAST [candidate] (20.78 ms) : 0, 20780
Remote Config [baseline] (646.827 µs) : 0, 647
Remote Config [candidate] (650.319 µs) : 0, 650
Telemetry [baseline] (8.547 ms) : 0, 8547
Telemetry [candidate] (8.558 ms) : 0, 8558
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1054211
Total [baseline] (10.434 s) : 0, 10434397
Agent [candidate] (1.052 s) : 0, 1052270
Total [candidate] (10.44 s) : 0, 10439888
section appsec
Agent [baseline] (1.184 s) : 0, 1184174
Total [baseline] (10.74 s) : 0, 10740280
Agent [candidate] (1.195 s) : 0, 1194769
Total [candidate] (10.728 s) : 0, 10727917
section iast
Agent [baseline] (1.183 s) : 0, 1183403
Total [baseline] (10.995 s) : 0, 10995132
Agent [candidate] (1.182 s) : 0, 1182474
Total [candidate] (10.932 s) : 0, 10932498
section profiling
Agent [baseline] (1.272 s) : 0, 1271781
Total [baseline] (10.799 s) : 0, 10798773
Agent [candidate] (1.272 s) : 0, 1271532
Total [candidate] (10.902 s) : 0, 10902362
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.184 s 129.963 ms (12.3%)
Agent iast 1.183 s 129.192 ms (12.3%)
Agent profiling 1.272 s 217.57 ms (20.6%)
Total tracing 10.434 s -
Total appsec 10.74 s 305.883 ms (2.9%)
Total iast 10.995 s 560.735 ms (5.4%)
Total profiling 10.799 s 364.375 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.195 s 142.5 ms (13.5%)
Agent iast 1.182 s 130.204 ms (12.4%)
Agent profiling 1.272 s 219.263 ms (20.8%)
Total tracing 10.44 s -
Total appsec 10.728 s 288.029 ms (2.8%)
Total iast 10.932 s 492.61 ms (4.7%)
Total profiling 10.902 s 462.474 ms (4.4%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.318 ms) : 0, 713318
BytebuddyAgent [candidate] (711.838 ms) : 0, 711838
GlobalTracer [baseline] (255.544 ms) : 0, 255544
GlobalTracer [candidate] (255.744 ms) : 0, 255744
AppSec [baseline] (55.314 ms) : 0, 55314
AppSec [candidate] (56.002 ms) : 0, 56002
Remote Config [baseline] (722.309 µs) : 0, 722
Remote Config [candidate] (733.117 µs) : 0, 733
Telemetry [baseline] (14.391 ms) : 0, 14391
Telemetry [candidate] (12.998 ms) : 0, 12998
section appsec
BytebuddyAgent [baseline] (728.113 ms) : 0, 728113
BytebuddyAgent [candidate] (735.385 ms) : 0, 735385
GlobalTracer [baseline] (251.912 ms) : 0, 251912
GlobalTracer [candidate] (254.458 ms) : 0, 254458
AppSec [baseline] (170.815 ms) : 0, 170815
AppSec [candidate] (170.968 ms) : 0, 170968
Remote Config [baseline] (665.724 µs) : 0, 666
Remote Config [candidate] (669.173 µs) : 0, 669
Telemetry [baseline] (8.138 ms) : 0, 8138
Telemetry [candidate] (8.547 ms) : 0, 8547
IAST [baseline] (19.268 ms) : 0, 19268
IAST [candidate] (19.248 ms) : 0, 19248
section iast
BytebuddyAgent [baseline] (832.394 ms) : 0, 832394
BytebuddyAgent [candidate] (831.319 ms) : 0, 831319
GlobalTracer [baseline] (247.057 ms) : 0, 247057
GlobalTracer [candidate] (247.099 ms) : 0, 247099
AppSec [baseline] (58.087 ms) : 0, 58087
AppSec [candidate] (58.175 ms) : 0, 58175
Remote Config [baseline] (689.968 µs) : 0, 690
Remote Config [candidate] (680.399 µs) : 0, 680
Telemetry [baseline] (8.751 ms) : 0, 8751
Telemetry [candidate] (8.719 ms) : 0, 8719
IAST [baseline] (21.416 ms) : 0, 21416
IAST [candidate] (21.436 ms) : 0, 21436
section profiling
BytebuddyAgent [baseline] (703.3 ms) : 0, 703300
BytebuddyAgent [candidate] (703.624 ms) : 0, 703624
GlobalTracer [baseline] (368.316 ms) : 0, 368316
GlobalTracer [candidate] (367.057 ms) : 0, 367057
AppSec [baseline] (53.934 ms) : 0, 53934
AppSec [candidate] (54.209 ms) : 0, 54209
Remote Config [baseline] (684.912 µs) : 0, 685
Remote Config [candidate] (684.758 µs) : 0, 685
Telemetry [baseline] (8.72 ms) : 0, 8720
Telemetry [candidate] (8.825 ms) : 0, 8825
ProfilingAgent [baseline] (94.964 ms) : 0, 94964
ProfilingAgent [candidate] (95.18 ms) : 0, 95180
Profiling [baseline] (94.988 ms) : 0, 94988
Profiling [candidate] (95.206 ms) : 0, 95206
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-13T14:24:26 2025-01-13T14:31:22
git_branch master smola/system-tests-20250113
git_commit_date 1736758880 1736777579
git_commit_sha 8bcee06 bb50ea5
release_version 1.46.0-SNAPSHOT~8bcee06789 1.46.0-SNAPSHOT~bb50ea5ee9
start_time 2025-01-13T14:24:12 2025-01-13T14:31:09
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736779034 1736779034
ci_job_id 763810425 763810425
ci_pipeline_id 52818476 52818476
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.072 µs) : 357, 399
.   : milestone, 378,
iast (489.835 µs) : 468, 511
.   : milestone, 490,
iast_FULL (652.13 µs) : 630, 674
.   : milestone, 652,
iast_GLOBAL (525.751 µs) : 503, 549
.   : milestone, 526,
iast_HARDCODED_SECRET_DISABLED (487.561 µs) : 466, 509
.   : milestone, 488,
iast_INACTIVE (449.388 µs) : 428, 471
.   : milestone, 449,
iast_TELEMETRY_OFF (482.865 µs) : 461, 504
.   : milestone, 483,
tracing (451.14 µs) : 431, 472
.   : milestone, 451,
section candidate
no_agent (375.533 µs) : 356, 395
.   : milestone, 376,
iast (484.178 µs) : 463, 506
.   : milestone, 484,
iast_FULL (652.298 µs) : 631, 674
.   : milestone, 652,
iast_GLOBAL (515.667 µs) : 494, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (487.181 µs) : 466, 509
.   : milestone, 487,
iast_INACTIVE (453.293 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (480.709 µs) : 459, 502
.   : milestone, 481,
tracing (445.048 µs) : 424, 466
.   : milestone, 445,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.072 µs [357.323 µs, 398.821 µs] -
iast 489.835 µs [468.307 µs, 511.363 µs] 111.763 µs (29.6%)
iast_FULL 652.13 µs [630.486 µs, 673.774 µs] 274.058 µs (72.5%)
iast_GLOBAL 525.751 µs [502.971 µs, 548.532 µs] 147.679 µs (39.1%)
iast_HARDCODED_SECRET_DISABLED 487.561 µs [466.061 µs, 509.062 µs] 109.489 µs (29.0%)
iast_INACTIVE 449.388 µs [427.855 µs, 470.922 µs] 71.316 µs (18.9%)
iast_TELEMETRY_OFF 482.865 µs [461.352 µs, 504.378 µs] 104.793 µs (27.7%)
tracing 451.14 µs [430.558 µs, 471.722 µs] 73.068 µs (19.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.533 µs [355.891 µs, 395.174 µs] -
iast 484.178 µs [462.783 µs, 505.573 µs] 108.646 µs (28.9%)
iast_FULL 652.298 µs [630.506 µs, 674.09 µs] 276.766 µs (73.7%)
iast_GLOBAL 515.667 µs [493.775 µs, 537.559 µs] 140.135 µs (37.3%)
iast_HARDCODED_SECRET_DISABLED 487.181 µs [465.774 µs, 508.588 µs] 111.648 µs (29.7%)
iast_INACTIVE 453.293 µs [432.149 µs, 474.438 µs] 77.761 µs (20.7%)
iast_TELEMETRY_OFF 480.709 µs [459.207 µs, 502.21 µs] 105.176 µs (28.0%)
tracing 445.048 µs [424.378 µs, 465.719 µs] 69.516 µs (18.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.329 ms) : 1310, 1348
.   : milestone, 1329,
appsec (1.746 ms) : 1722, 1771
.   : milestone, 1746,
appsec_no_iast (1.723 ms) : 1698, 1747
.   : milestone, 1723,
iast (1.49 ms) : 1468, 1513
.   : milestone, 1490,
profiling (1.526 ms) : 1501, 1550
.   : milestone, 1526,
tracing (1.482 ms) : 1456, 1507
.   : milestone, 1482,
section candidate
no_agent (1.365 ms) : 1346, 1384
.   : milestone, 1365,
appsec (1.73 ms) : 1706, 1754
.   : milestone, 1730,
appsec_no_iast (1.731 ms) : 1708, 1754
.   : milestone, 1731,
iast (1.491 ms) : 1468, 1513
.   : milestone, 1491,
profiling (1.501 ms) : 1478, 1524
.   : milestone, 1501,
tracing (1.487 ms) : 1463, 1511
.   : milestone, 1487,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.329 ms [1.31 ms, 1.348 ms] -
appsec 1.746 ms [1.722 ms, 1.771 ms] 417.198 µs (31.4%)
appsec_no_iast 1.723 ms [1.698 ms, 1.747 ms] 393.619 µs (29.6%)
iast 1.49 ms [1.468 ms, 1.513 ms] 161.099 µs (12.1%)
profiling 1.526 ms [1.501 ms, 1.55 ms] 196.778 µs (14.8%)
tracing 1.482 ms [1.456 ms, 1.507 ms] 152.501 µs (11.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.365 ms [1.346 ms, 1.384 ms] -
appsec 1.73 ms [1.706 ms, 1.754 ms] 365.546 µs (26.8%)
appsec_no_iast 1.731 ms [1.708 ms, 1.754 ms] 366.432 µs (26.9%)
iast 1.491 ms [1.468 ms, 1.513 ms] 126.254 µs (9.3%)
profiling 1.501 ms [1.478 ms, 1.524 ms] 136.199 µs (10.0%)
tracing 1.487 ms [1.463 ms, 1.511 ms] 122.125 µs (8.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20250113
git_commit_date 1736758880 1736777579
git_commit_sha 8bcee06 bb50ea5
release_version 1.46.0-SNAPSHOT~8bcee06789 1.46.0-SNAPSHOT~bb50ea5ee9
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1736779665 1736779665
ci_job_id 763810426 763810426
ci_pipeline_id 52818476 52818476
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.697 s) : 14697000, 14697000
.   : milestone, 14697000,
appsec (15.086 s) : 15086000, 15086000
.   : milestone, 15086000,
iast (18.43 s) : 18430000, 18430000
.   : milestone, 18430000,
iast_GLOBAL (18.276 s) : 18276000, 18276000
.   : milestone, 18276000,
profiling (15.13 s) : 15130000, 15130000
.   : milestone, 15130000,
tracing (15.23 s) : 15230000, 15230000
.   : milestone, 15230000,
section candidate
no_agent (15.012 s) : 15012000, 15012000
.   : milestone, 15012000,
appsec (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
iast (19.184 s) : 19184000, 19184000
.   : milestone, 19184000,
iast_GLOBAL (17.992 s) : 17992000, 17992000
.   : milestone, 17992000,
profiling (15.22 s) : 15220000, 15220000
.   : milestone, 15220000,
tracing (14.958 s) : 14958000, 14958000
.   : milestone, 14958000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.697 s [14.697 s, 14.697 s] -
appsec 15.086 s [15.086 s, 15.086 s] 389.0 ms (2.6%)
iast 18.43 s [18.43 s, 18.43 s] 3.733 s (25.4%)
iast_GLOBAL 18.276 s [18.276 s, 18.276 s] 3.579 s (24.4%)
profiling 15.13 s [15.13 s, 15.13 s] 433.0 ms (2.9%)
tracing 15.23 s [15.23 s, 15.23 s] 533.0 ms (3.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.012 s [15.012 s, 15.012 s] -
appsec 15.075 s [15.075 s, 15.075 s] 63.0 ms (0.4%)
iast 19.184 s [19.184 s, 19.184 s] 4.172 s (27.8%)
iast_GLOBAL 17.992 s [17.992 s, 17.992 s] 2.98 s (19.9%)
profiling 15.22 s [15.22 s, 15.22 s] 208.0 ms (1.4%)
tracing 14.958 s [14.958 s, 14.958 s] -54.0 ms (-0.4%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~bb50ea5ee9, baseline=1.46.0-SNAPSHOT~8bcee06789
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.379 ms) : 2336, 2422
.   : milestone, 2379,
iast (2.128 ms) : 2073, 2182
.   : milestone, 2128,
iast_GLOBAL (2.175 ms) : 2120, 2231
.   : milestone, 2175,
profiling (1.986 ms) : 1942, 2031
.   : milestone, 1986,
tracing (1.958 ms) : 1916, 2000
.   : milestone, 1958,
section candidate
no_agent (1.479 ms) : 1467, 1490
.   : milestone, 1479,
appsec (2.361 ms) : 2318, 2403
.   : milestone, 2361,
iast (2.132 ms) : 2078, 2187
.   : milestone, 2132,
iast_GLOBAL (2.163 ms) : 2108, 2218
.   : milestone, 2163,
profiling (2.48 ms) : 2290, 2670
.   : milestone, 2480,
tracing (1.95 ms) : 1908, 1992
.   : milestone, 1950,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.379 ms [2.336 ms, 2.422 ms] 902.658 µs (61.1%)
iast 2.128 ms [2.073 ms, 2.182 ms] 651.111 µs (44.1%)
iast_GLOBAL 2.175 ms [2.12 ms, 2.231 ms] 698.97 µs (47.3%)
profiling 1.986 ms [1.942 ms, 2.031 ms] 509.934 µs (34.5%)
tracing 1.958 ms [1.916 ms, 2.0 ms] 481.508 µs (32.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.467 ms, 1.49 ms] -
appsec 2.361 ms [2.318 ms, 2.403 ms] 882.042 µs (59.7%)
iast 2.132 ms [2.078 ms, 2.187 ms] 653.752 µs (44.2%)
iast_GLOBAL 2.163 ms [2.108 ms, 2.218 ms] 684.815 µs (46.3%)
profiling 2.48 ms [2.29 ms, 2.67 ms] 1.001 ms (67.7%)
tracing 1.95 ms [1.908 ms, 1.992 ms] 471.886 µs (31.9%)

@smola smola marked this pull request as ready for review January 14, 2025 14:21
@smola smola requested a review from a team as a code owner January 14, 2025 14:21
@smola smola requested a review from nayeem-kamal January 14, 2025 14:21
@PerfectSlayer PerfectSlayer mentioned this pull request Jan 14, 2025
Merged
@PerfectSlayer
Copy link
Contributor

Closing as outdated/duplicate

@smola smola closed this Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@nayeem-kamal nayeem-kamal Awaiting requested review from nayeem-kamal nayeem-kamal is a code owner automatically assigned from DataDog/apm-java

Assignees
No one assigned
Labels
comp: testing Testing tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@smola @PerfectSlayer