Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] Add file attribute to JUnit report #8143

Draft
wants to merge 17 commits into
base: master
Choose a base branch
from
Draft

[WIP] Add file attribute to JUnit report #8143

wants to merge 17 commits into from

Conversation

sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Jan 2, 2025 •
edited
Loading

What Does This Do

Right now, this PR isolates a single test and attempts to add a JUnit extension that prints the test class and method.

Motivation

The eventual goal of this PR is to add the source file attribute to the <testcase> elements in the JUnit XML report that is produced after tests are run. This will eventually allow us to assign codeowner data. However, this PR is attempting to just first obtain the test source file information by extracting test data.

Additional Notes

Contributor Checklist

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-80

@pr-commenter
Copy link

pr-commenter bot commented Jan 2, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/add-files-to-junit-reports-2
git_commit_date 1736792263 1736798234
git_commit_sha d402356 349bb5b
release_version 1.46.0-SNAPSHOT~d402356031 1.46.0-SNAPSHOT~349bb5bc45
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736800635 1736800635
ci_job_id 764557769 764557769
ci_pipeline_id 52870715 52870715
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055321
Total [baseline] (10.469 s) : 0, 10469053
Agent [candidate] (1.057 s) : 0, 1057193
Total [candidate] (10.426 s) : 0, 10425546
section appsec
Agent [baseline] (1.191 s) : 0, 1191025
Total [baseline] (10.725 s) : 0, 10724870
Agent [candidate] (1.19 s) : 0, 1189887
Total [candidate] (10.682 s) : 0, 10682378
section iast
Agent [baseline] (1.185 s) : 0, 1184546
Total [baseline] (10.96 s) : 0, 10960106
Agent [candidate] (1.19 s) : 0, 1190042
Total [candidate] (11.07 s) : 0, 11069785
section profiling
Agent [baseline] (1.279 s) : 0, 1279455
Total [baseline] (10.878 s) : 0, 10878057
Agent [candidate] (1.272 s) : 0, 1271614
Total [candidate] (10.834 s) : 0, 10833934
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.191 s 135.704 ms (12.9%)
Agent iast 1.185 s 129.226 ms (12.2%)
Agent profiling 1.279 s 224.134 ms (21.2%)
Total tracing 10.469 s -
Total appsec 10.725 s 255.817 ms (2.4%)
Total iast 10.96 s 491.053 ms (4.7%)
Total profiling 10.878 s 409.004 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.19 s 132.695 ms (12.6%)
Agent iast 1.19 s 132.849 ms (12.6%)
Agent profiling 1.272 s 214.421 ms (20.3%)
Total tracing 10.426 s -
Total appsec 10.682 s 256.832 ms (2.5%)
Total iast 11.07 s 644.239 ms (6.2%)
Total profiling 10.834 s 408.388 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.032 ms) : 0, 714032
BytebuddyAgent [candidate] (714.236 ms) : 0, 714236
GlobalTracer [baseline] (255.998 ms) : 0, 255998
GlobalTracer [candidate] (256.299 ms) : 0, 256299
AppSec [baseline] (55.811 ms) : 0, 55811
AppSec [candidate] (56.03 ms) : 0, 56030
Remote Config [baseline] (724.268 µs) : 0, 724
Remote Config [candidate] (718.969 µs) : 0, 719
Telemetry [baseline] (13.71 ms) : 0, 13710
Telemetry [candidate] (14.875 ms) : 0, 14875
section appsec
BytebuddyAgent [baseline] (733.041 ms) : 0, 733041
BytebuddyAgent [candidate] (732.107 ms) : 0, 732107
GlobalTracer [baseline] (253.47 ms) : 0, 253470
GlobalTracer [candidate] (253.282 ms) : 0, 253282
AppSec [baseline] (170.986 ms) : 0, 170986
AppSec [candidate] (170.66 ms) : 0, 170660
Remote Config [baseline] (665.814 µs) : 0, 666
Remote Config [candidate] (660.992 µs) : 0, 661
Telemetry [baseline] (8.189 ms) : 0, 8189
Telemetry [candidate] (8.57 ms) : 0, 8570
IAST [baseline] (19.284 ms) : 0, 19284
IAST [candidate] (19.162 ms) : 0, 19162
section iast
BytebuddyAgent [baseline] (832.897 ms) : 0, 832897
BytebuddyAgent [candidate] (837.321 ms) : 0, 837321
GlobalTracer [baseline] (247.728 ms) : 0, 247728
GlobalTracer [candidate] (248.378 ms) : 0, 248378
AppSec [baseline] (58.06 ms) : 0, 58060
AppSec [candidate] (58.315 ms) : 0, 58315
Remote Config [baseline] (670.278 µs) : 0, 670
Remote Config [candidate] (666.969 µs) : 0, 667
Telemetry [baseline] (8.766 ms) : 0, 8766
Telemetry [candidate] (8.833 ms) : 0, 8833
IAST [baseline] (21.374 ms) : 0, 21374
IAST [candidate] (21.39 ms) : 0, 21390
section profiling
ProfilingAgent [baseline] (95.872 ms) : 0, 95872
ProfilingAgent [candidate] (95.352 ms) : 0, 95352
BytebuddyAgent [baseline] (706.737 ms) : 0, 706737
BytebuddyAgent [candidate] (703.924 ms) : 0, 703924
GlobalTracer [baseline] (370.826 ms) : 0, 370826
GlobalTracer [candidate] (366.433 ms) : 0, 366433
AppSec [baseline] (54.35 ms) : 0, 54350
AppSec [candidate] (54.455 ms) : 0, 54455
Remote Config [baseline] (694.388 µs) : 0, 694
Remote Config [candidate] (693.043 µs) : 0, 693
Telemetry [baseline] (8.819 ms) : 0, 8819
Telemetry [candidate] (8.773 ms) : 0, 8773
Profiling [baseline] (95.896 ms) : 0, 95896
Profiling [candidate] (95.376 ms) : 0, 95376
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059571
Total [baseline] (8.669 s) : 0, 8669039
Agent [candidate] (1.055 s) : 0, 1054935
Total [candidate] (8.62 s) : 0, 8620473
section iast
Agent [baseline] (1.18 s) : 0, 1179962
Total [baseline] (9.216 s) : 0, 9215909
Agent [candidate] (1.191 s) : 0, 1190683
Total [candidate] (9.228 s) : 0, 9228041
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1179886
Total [baseline] (9.169 s) : 0, 9169319
Agent [candidate] (1.195 s) : 0, 1195090
Total [candidate] (9.212 s) : 0, 9211678
section iast_TELEMETRY_OFF
Agent [baseline] (1.184 s) : 0, 1184000
Total [baseline] (9.178 s) : 0, 9178061
Agent [candidate] (1.18 s) : 0, 1179540
Total [candidate] (9.199 s) : 0, 9198677
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.18 s 120.39 ms (11.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 120.315 ms (11.4%)
Agent iast_TELEMETRY_OFF 1.184 s 124.429 ms (11.7%)
Total tracing 8.669 s -
Total iast 9.216 s 546.87 ms (6.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.169 s 500.28 ms (5.8%)
Total iast_TELEMETRY_OFF 9.178 s 509.022 ms (5.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.191 s 135.748 ms (12.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.195 s 140.154 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.18 s 124.605 ms (11.8%)
Total tracing 8.62 s -
Total iast 9.228 s 607.569 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.212 s 591.205 ms (6.9%)
Total iast_TELEMETRY_OFF 9.199 s 578.205 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.486 ms) : 0, 717486
BytebuddyAgent [candidate] (712.976 ms) : 0, 712976
GlobalTracer [baseline] (256.863 ms) : 0, 256863
GlobalTracer [candidate] (255.849 ms) : 0, 255849
AppSec [baseline] (55.841 ms) : 0, 55841
AppSec [candidate] (55.283 ms) : 0, 55283
Remote Config [baseline] (722.531 µs) : 0, 723
Remote Config [candidate] (711.771 µs) : 0, 712
Telemetry [baseline] (13.68 ms) : 0, 13680
Telemetry [candidate] (15.09 ms) : 0, 15090
section iast
BytebuddyAgent [baseline] (829.993 ms) : 0, 829993
BytebuddyAgent [candidate] (837.716 ms) : 0, 837716
GlobalTracer [baseline] (246.195 ms) : 0, 246195
GlobalTracer [candidate] (248.355 ms) : 0, 248355
AppSec [baseline] (57.89 ms) : 0, 57890
AppSec [candidate] (58.299 ms) : 0, 58299
IAST [baseline] (21.495 ms) : 0, 21495
IAST [candidate] (21.64 ms) : 0, 21640
Remote Config [baseline] (668.244 µs) : 0, 668
Remote Config [candidate] (692.286 µs) : 0, 692
Telemetry [baseline] (8.786 ms) : 0, 8786
Telemetry [candidate] (8.858 ms) : 0, 8858
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (829.69 ms) : 0, 829690
BytebuddyAgent [candidate] (841.196 ms) : 0, 841196
GlobalTracer [baseline] (246.346 ms) : 0, 246346
GlobalTracer [candidate] (248.529 ms) : 0, 248529
AppSec [baseline] (57.96 ms) : 0, 57960
AppSec [candidate] (58.919 ms) : 0, 58919
IAST [baseline] (21.47 ms) : 0, 21470
IAST [candidate] (21.587 ms) : 0, 21587
Remote Config [baseline] (656.672 µs) : 0, 657
Remote Config [candidate] (685.426 µs) : 0, 685
Telemetry [baseline] (8.766 ms) : 0, 8766
Telemetry [candidate] (8.909 ms) : 0, 8909
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.07 ms) : 0, 833070
BytebuddyAgent [candidate] (829.661 ms) : 0, 829661
GlobalTracer [baseline] (247.384 ms) : 0, 247384
GlobalTracer [candidate] (247.188 ms) : 0, 247188
AppSec [baseline] (58.132 ms) : 0, 58132
AppSec [candidate] (57.609 ms) : 0, 57609
IAST [baseline] (20.888 ms) : 0, 20888
IAST [candidate] (20.841 ms) : 0, 20841
Remote Config [baseline] (674.506 µs) : 0, 675
Remote Config [candidate] (649.953 µs) : 0, 650
Telemetry [baseline] (8.755 ms) : 0, 8755
Telemetry [candidate] (8.607 ms) : 0, 8607
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-13T20:07:50 2025-01-13T20:14:48
git_branch master sarahchen6/add-files-to-junit-reports-2
git_commit_date 1736792263 1736798234
git_commit_sha d402356 349bb5b
release_version 1.46.0-SNAPSHOT~d402356031 1.46.0-SNAPSHOT~349bb5bc45
start_time 2025-01-13T20:07:36 2025-01-13T20:14:35
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1736799642 1736799642
ci_job_id 764557771 764557771
ci_pipeline_id 52870715 52870715
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 12 metrics, 15 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+36.339µs; +87.447µs] or [+2.417%; +5.817%]		 unstable
[-677.002op/s; +449.082op/s] or [-22.003%; +14.595%]		 1.565ms 2962.963op/s 1.503ms 3076.923op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.348 ms) : 1328, 1367
.   : milestone, 1348,
appsec (1.742 ms) : 1719, 1766
.   : milestone, 1742,
appsec_no_iast (1.751 ms) : 1728, 1775
.   : milestone, 1751,
iast (1.521 ms) : 1498, 1543
.   : milestone, 1521,
profiling (1.503 ms) : 1480, 1527
.   : milestone, 1503,
tracing (1.494 ms) : 1469, 1518
.   : milestone, 1494,
section candidate
no_agent (1.36 ms) : 1340, 1379
.   : milestone, 1360,
appsec (1.75 ms) : 1726, 1774
.   : milestone, 1750,
appsec_no_iast (1.754 ms) : 1729, 1779
.   : milestone, 1754,
iast (1.5 ms) : 1477, 1523
.   : milestone, 1500,
profiling (1.565 ms) : 1541, 1590
.   : milestone, 1565,
tracing (1.504 ms) : 1477, 1530
.   : milestone, 1504,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.328 ms, 1.367 ms] -
appsec 1.742 ms [1.719 ms, 1.766 ms] 394.619 µs (29.3%)
appsec_no_iast 1.751 ms [1.728 ms, 1.775 ms] 403.34 µs (29.9%)
iast 1.521 ms [1.498 ms, 1.543 ms] 172.879 µs (12.8%)
profiling 1.503 ms [1.48 ms, 1.527 ms] 155.683 µs (11.6%)
tracing 1.494 ms [1.469 ms, 1.518 ms] 146.059 µs (10.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.36 ms [1.34 ms, 1.379 ms] -
appsec 1.75 ms [1.726 ms, 1.774 ms] 390.545 µs (28.7%)
appsec_no_iast 1.754 ms [1.729 ms, 1.779 ms] 393.997 µs (29.0%)
iast 1.5 ms [1.477 ms, 1.523 ms] 140.112 µs (10.3%)
profiling 1.565 ms [1.541 ms, 1.59 ms] 205.461 µs (15.1%)
tracing 1.504 ms [1.477 ms, 1.53 ms] 143.703 µs (10.6%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031
    dateFormat X
    axisFormat %s
section baseline
no_agent (375.996 µs) : 356, 396
.   : milestone, 376,
iast (489.941 µs) : 469, 511
.   : milestone, 490,
iast_FULL (664.32 µs) : 643, 686
.   : milestone, 664,
iast_GLOBAL (520.523 µs) : 499, 542
.   : milestone, 521,
iast_HARDCODED_SECRET_DISABLED (497.605 µs) : 476, 519
.   : milestone, 498,
iast_INACTIVE (466.547 µs) : 445, 488
.   : milestone, 467,
iast_TELEMETRY_OFF (482.68 µs) : 461, 504
.   : milestone, 483,
tracing (464.877 µs) : 444, 486
.   : milestone, 465,
section candidate
no_agent (378.828 µs) : 359, 399
.   : milestone, 379,
iast (494.76 µs) : 473, 516
.   : milestone, 495,
iast_FULL (653.652 µs) : 632, 675
.   : milestone, 654,
iast_GLOBAL (523.933 µs) : 503, 545
.   : milestone, 524,
iast_HARDCODED_SECRET_DISABLED (492.686 µs) : 471, 514
.   : milestone, 493,
iast_INACTIVE (455.522 µs) : 434, 477
.   : milestone, 456,
iast_TELEMETRY_OFF (475.278 µs) : 454, 497
.   : milestone, 475,
tracing (456.598 µs) : 436, 478
.   : milestone, 457,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 375.996 µs [356.323 µs, 395.669 µs] -
iast 489.941 µs [468.621 µs, 511.26 µs] 113.945 µs (30.3%)
iast_FULL 664.32 µs [642.617 µs, 686.024 µs] 288.324 µs (76.7%)
iast_GLOBAL 520.523 µs [499.045 µs, 542.002 µs] 144.527 µs (38.4%)
iast_HARDCODED_SECRET_DISABLED 497.605 µs [475.93 µs, 519.279 µs] 121.609 µs (32.3%)
iast_INACTIVE 466.547 µs [445.379 µs, 487.715 µs] 90.551 µs (24.1%)
iast_TELEMETRY_OFF 482.68 µs [461.487 µs, 503.872 µs] 106.684 µs (28.4%)
tracing 464.877 µs [443.972 µs, 485.782 µs] 88.881 µs (23.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.828 µs [358.909 µs, 398.747 µs] -
iast 494.76 µs [473.368 µs, 516.152 µs] 115.932 µs (30.6%)
iast_FULL 653.652 µs [632.007 µs, 675.298 µs] 274.824 µs (72.5%)
iast_GLOBAL 523.933 µs [502.74 µs, 545.126 µs] 145.105 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED 492.686 µs [471.292 µs, 514.08 µs] 113.858 µs (30.1%)
iast_INACTIVE 455.522 µs [434.179 µs, 476.866 µs] 76.694 µs (20.2%)
iast_TELEMETRY_OFF 475.278 µs [453.936 µs, 496.62 µs] 96.45 µs (25.5%)
tracing 456.598 µs [435.541 µs, 477.654 µs] 77.77 µs (20.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/add-files-to-junit-reports-2
git_commit_date 1736792263 1736798234
git_commit_sha d402356 349bb5b
release_version 1.46.0-SNAPSHOT~d402356031 1.46.0-SNAPSHOT~349bb5bc45
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1736800190 1736800190
ci_job_id 764557773 764557773
ci_pipeline_id 52870715 52870715
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.462 ms) : 1450, 1473
.   : milestone, 1462,
appsec (2.343 ms) : 2301, 2386
.   : milestone, 2343,
iast (2.091 ms) : 2037, 2145
.   : milestone, 2091,
iast_GLOBAL (2.139 ms) : 2084, 2194
.   : milestone, 2139,
profiling (1.958 ms) : 1915, 2001
.   : milestone, 1958,
tracing (1.928 ms) : 1887, 1970
.   : milestone, 1928,
section candidate
no_agent (1.465 ms) : 1453, 1476
.   : milestone, 1465,
appsec (2.344 ms) : 2302, 2387
.   : milestone, 2344,
iast (2.093 ms) : 2039, 2147
.   : milestone, 2093,
iast_GLOBAL (2.134 ms) : 2079, 2188
.   : milestone, 2134,
profiling (1.962 ms) : 1918, 2005
.   : milestone, 1962,
tracing (1.927 ms) : 1886, 1969
.   : milestone, 1927,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.462 ms [1.45 ms, 1.473 ms] -
appsec 2.343 ms [2.301 ms, 2.386 ms] 881.655 µs (60.3%)
iast 2.091 ms [2.037 ms, 2.145 ms] 629.409 µs (43.1%)
iast_GLOBAL 2.139 ms [2.084 ms, 2.194 ms] 677.266 µs (46.3%)
profiling 1.958 ms [1.915 ms, 2.001 ms] 496.555 µs (34.0%)
tracing 1.928 ms [1.887 ms, 1.97 ms] 466.665 µs (31.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.453 ms, 1.476 ms] -
appsec 2.344 ms [2.302 ms, 2.387 ms] 879.71 µs (60.1%)
iast 2.093 ms [2.039 ms, 2.147 ms] 628.437 µs (42.9%)
iast_GLOBAL 2.134 ms [2.079 ms, 2.188 ms] 669.241 µs (45.7%)
profiling 1.962 ms [1.918 ms, 2.005 ms] 497.192 µs (33.9%)
tracing 1.927 ms [1.886 ms, 1.969 ms] 462.604 µs (31.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~349bb5bc45, baseline=1.46.0-SNAPSHOT~d402356031
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
appsec (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
iast (18.754 s) : 18754000, 18754000
.   : milestone, 18754000,
iast_GLOBAL (18.089 s) : 18089000, 18089000
.   : milestone, 18089000,
profiling (15.22 s) : 15220000, 15220000
.   : milestone, 15220000,
tracing (15.037 s) : 15037000, 15037000
.   : milestone, 15037000,
section candidate
no_agent (14.978 s) : 14978000, 14978000
.   : milestone, 14978000,
appsec (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
iast (18.882 s) : 18882000, 18882000
.   : milestone, 18882000,
iast_GLOBAL (17.771 s) : 17771000, 17771000
.   : milestone, 17771000,
profiling (14.929 s) : 14929000, 14929000
.   : milestone, 14929000,
tracing (14.867 s) : 14867000, 14867000
.   : milestone, 14867000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.412 s [15.412 s, 15.412 s] -
appsec 14.923 s [14.923 s, 14.923 s] -489.0 ms (-3.2%)
iast 18.754 s [18.754 s, 18.754 s] 3.342 s (21.7%)
iast_GLOBAL 18.089 s [18.089 s, 18.089 s] 2.677 s (17.4%)
profiling 15.22 s [15.22 s, 15.22 s] -192.0 ms (-1.2%)
tracing 15.037 s [15.037 s, 15.037 s] -375.0 ms (-2.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.978 s [14.978 s, 14.978 s] -
appsec 15.124 s [15.124 s, 15.124 s] 146.0 ms (1.0%)
iast 18.882 s [18.882 s, 18.882 s] 3.904 s (26.1%)
iast_GLOBAL 17.771 s [17.771 s, 17.771 s] 2.793 s (18.6%)
profiling 14.929 s [14.929 s, 14.929 s] -49.0 ms (-0.3%)
tracing 14.867 s [14.867 s, 14.867 s] -111.0 ms (-0.7%)

@sarahchen6 sarahchen6 force-pushed the sarahchen6/add-files-to-junit-reports-2 branch 8 times, most recently from f898f22 to 295d7cf Compare January 9, 2025 22:39
@sarahchen6 sarahchen6 force-pushed the sarahchen6/add-files-to-junit-reports-2 branch from 295d7cf to 114bead Compare January 10, 2025 21:11
@sarahchen6 sarahchen6 force-pushed the sarahchen6/add-files-to-junit-reports-2 branch from 114bead to 349bb5b Compare January 13, 2025 19:57
@sarahchen6 sarahchen6 mentioned this pull request Jan 15, 2025
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@sarahchen6