Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix debugger system tests CI logs upload #7987

Merged
merged 1 commit into from
Dec 9, 2024
Merged

Fix debugger system tests CI logs upload #7987

merged 1 commit into from
Dec 9, 2024

Conversation

shurivich
Copy link
Contributor

@shurivich shurivich commented Nov 20, 2024 •
edited
Loading

What Does This Do

Fix debugger system tests logs upload

@shurivich shurivich added the comp: debugger Dynamic Instrumentation label Nov 20, 2024
@shurivich shurivich self-assigned this Nov 20, 2024
@pr-commenter
Copy link

pr-commenter bot commented Nov 20, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master shurivich/debugger_system_tests
git_commit_date 1733503294 1733665508
git_commit_sha 0db6312 73955ae
release_version 1.44.0-SNAPSHOT~0db63127b0 1.44.0-SNAPSHOT~73955ae8ce
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1733667964 1733667964
ci_job_id 730131027 730131027
ci_pipeline_id 50515894 50515894
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1100157
Total [baseline] (8.699 s) : 0, 8698819
Agent [candidate] (1.09 s) : 0, 1089823
Total [candidate] (8.653 s) : 0, 8652513
section iast
Agent [baseline] (1.218 s) : 0, 1217509
Total [baseline] (9.212 s) : 0, 9211967
Agent [candidate] (1.231 s) : 0, 1231423
Total [candidate] (9.264 s) : 0, 9263806
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.219 s) : 0, 1219378
Total [baseline] (9.168 s) : 0, 9167995
Agent [candidate] (1.23 s) : 0, 1230409
Total [candidate] (9.176 s) : 0, 9176331
section iast_TELEMETRY_OFF
Agent [baseline] (1.215 s) : 0, 1214613
Total [baseline] (9.163 s) : 0, 9163130
Agent [candidate] (1.219 s) : 0, 1219299
Total [candidate] (9.207 s) : 0, 9206936
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.1 s -
Agent iast 1.218 s 117.353 ms (10.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.219 s 119.221 ms (10.8%)
Agent iast_TELEMETRY_OFF 1.215 s 114.457 ms (10.4%)
Total tracing 8.699 s -
Total iast 9.212 s 513.148 ms (5.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.168 s 469.176 ms (5.4%)
Total iast_TELEMETRY_OFF 9.163 s 464.31 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.231 s 141.6 ms (13.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.23 s 140.587 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.219 s 129.476 ms (11.9%)
Total tracing 8.653 s -
Total iast 9.264 s 611.293 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.176 s 523.817 ms (6.1%)
Total iast_TELEMETRY_OFF 9.207 s 554.422 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (700.956 ms) : 0, 700956
BytebuddyAgent [candidate] (694.596 ms) : 0, 694596
GlobalTracer [baseline] (319.918 ms) : 0, 319918
GlobalTracer [candidate] (317.669 ms) : 0, 317669
AppSec [baseline] (54.831 ms) : 0, 54831
AppSec [candidate] (54.62 ms) : 0, 54620
Remote Config [baseline] (739.27 µs) : 0, 739
Remote Config [candidate] (694.171 µs) : 0, 694
Telemetry [baseline] (9.81 ms) : 0, 9810
Telemetry [candidate] (8.399 ms) : 0, 8399
section iast
BytebuddyAgent [baseline] (810.626 ms) : 0, 810626
BytebuddyAgent [candidate] (822.635 ms) : 0, 822635
GlobalTracer [baseline] (306.038 ms) : 0, 306038
GlobalTracer [candidate] (307.915 ms) : 0, 307915
AppSec [baseline] (57.968 ms) : 0, 57968
AppSec [candidate] (56.979 ms) : 0, 56979
IAST [baseline] (20.847 ms) : 0, 20847
IAST [candidate] (21.775 ms) : 0, 21775
Remote Config [baseline] (651.406 µs) : 0, 651
Remote Config [candidate] (636.383 µs) : 0, 636
Telemetry [baseline] (7.595 ms) : 0, 7595
Telemetry [candidate] (7.547 ms) : 0, 7547
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (812.623 ms) : 0, 812623
BytebuddyAgent [candidate] (820.119 ms) : 0, 820119
GlobalTracer [baseline] (306.145 ms) : 0, 306145
GlobalTracer [candidate] (308.642 ms) : 0, 308642
AppSec [baseline] (57.799 ms) : 0, 57799
AppSec [candidate] (58.079 ms) : 0, 58079
IAST [baseline] (20.876 ms) : 0, 20876
IAST [candidate] (21.331 ms) : 0, 21331
Remote Config [baseline] (642.165 µs) : 0, 642
Remote Config [candidate] (645.867 µs) : 0, 646
Telemetry [baseline] (7.531 ms) : 0, 7531
Telemetry [candidate] (7.667 ms) : 0, 7667
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (808.902 ms) : 0, 808902
BytebuddyAgent [candidate] (811.47 ms) : 0, 811470
GlobalTracer [baseline] (305.732 ms) : 0, 305732
GlobalTracer [candidate] (307.594 ms) : 0, 307594
AppSec [baseline] (57.571 ms) : 0, 57571
AppSec [candidate] (57.874 ms) : 0, 57874
IAST [baseline] (20.54 ms) : 0, 20540
IAST [candidate] (20.44 ms) : 0, 20440
Remote Config [baseline] (629.015 µs) : 0, 629
Remote Config [candidate] (632.418 µs) : 0, 632
Telemetry [baseline] (7.482 ms) : 0, 7482
Telemetry [candidate] (7.463 ms) : 0, 7463
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090865
Total [baseline] (10.435 s) : 0, 10434600
Agent [candidate] (1.11 s) : 0, 1109742
Total [candidate] (10.441 s) : 0, 10441386
section appsec
Agent [baseline] (1.222 s) : 0, 1222244
Total [baseline] (10.706 s) : 0, 10706266
Agent [candidate] (1.237 s) : 0, 1237393
Total [candidate] (10.775 s) : 0, 10775351
section iast
Agent [baseline] (1.221 s) : 0, 1221175
Total [baseline] (10.963 s) : 0, 10962930
Agent [candidate] (1.226 s) : 0, 1225687
Total [candidate] (11.01 s) : 0, 11010009
section profiling
Agent [baseline] (1.315 s) : 0, 1314868
Total [baseline] (10.808 s) : 0, 10807844
Agent [candidate] (1.337 s) : 0, 1336683
Total [candidate] (10.916 s) : 0, 10915715
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent appsec 1.222 s 131.379 ms (12.0%)
Agent iast 1.221 s 130.309 ms (11.9%)
Agent profiling 1.315 s 224.002 ms (20.5%)
Total tracing 10.435 s -
Total appsec 10.706 s 271.666 ms (2.6%)
Total iast 10.963 s 528.33 ms (5.1%)
Total profiling 10.808 s 373.245 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.11 s -
Agent appsec 1.237 s 127.652 ms (11.5%)
Agent iast 1.226 s 115.945 ms (10.4%)
Agent profiling 1.337 s 226.942 ms (20.4%)
Total tracing 10.441 s -
Total appsec 10.775 s 333.964 ms (3.2%)
Total iast 11.01 s 568.623 ms (5.4%)
Total profiling 10.916 s 474.329 ms (4.5%) 
gantt
    title petclinic - break down per module: candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (693.822 ms) : 0, 693822
BytebuddyAgent [candidate] (705.457 ms) : 0, 705457
GlobalTracer [baseline] (317.544 ms) : 0, 317544
GlobalTracer [candidate] (322.368 ms) : 0, 322368
AppSec [baseline] (54.492 ms) : 0, 54492
AppSec [candidate] (55.69 ms) : 0, 55690
Remote Config [baseline] (679.44 µs) : 0, 679
Remote Config [candidate] (696.207 µs) : 0, 696
Telemetry [baseline] (10.603 ms) : 0, 10603
Telemetry [candidate] (11.6 ms) : 0, 11600
section appsec
BytebuddyAgent [baseline] (709.236 ms) : 0, 709236
BytebuddyAgent [candidate] (719.257 ms) : 0, 719257
GlobalTracer [baseline] (314.132 ms) : 0, 314132
GlobalTracer [candidate] (317.402 ms) : 0, 317402
AppSec [baseline] (167.339 ms) : 0, 167339
AppSec [candidate] (168.077 ms) : 0, 168077
Remote Config [baseline] (1.009 ms) : 0, 1009
Remote Config [candidate] (657.739 µs) : 0, 658
Telemetry [baseline] (7.401 ms) : 0, 7401
Telemetry [candidate] (8.578 ms) : 0, 8578
IAST [baseline] (18.84 ms) : 0, 18840
IAST [candidate] (18.992 ms) : 0, 18992
section iast
BytebuddyAgent [baseline] (813.839 ms) : 0, 813839
BytebuddyAgent [candidate] (817.255 ms) : 0, 817255
GlobalTracer [baseline] (306.758 ms) : 0, 306758
GlobalTracer [candidate] (307.572 ms) : 0, 307572
AppSec [baseline] (57.076 ms) : 0, 57076
AppSec [candidate] (57.778 ms) : 0, 57778
Remote Config [baseline] (630.012 µs) : 0, 630
Remote Config [candidate] (658.473 µs) : 0, 658
Telemetry [baseline] (7.525 ms) : 0, 7525
Telemetry [candidate] (7.577 ms) : 0, 7577
IAST [baseline] (21.572 ms) : 0, 21572
IAST [candidate] (20.992 ms) : 0, 20992
section profiling
BytebuddyAgent [baseline] (688.025 ms) : 0, 688025
BytebuddyAgent [candidate] (698.906 ms) : 0, 698906
GlobalTracer [baseline] (432.693 ms) : 0, 432693
GlobalTracer [candidate] (439.219 ms) : 0, 439219
AppSec [baseline] (53.334 ms) : 0, 53334
AppSec [candidate] (54.667 ms) : 0, 54667
Remote Config [baseline] (663.424 µs) : 0, 663
Remote Config [candidate] (671.443 µs) : 0, 671
Telemetry [baseline] (7.694 ms) : 0, 7694
Telemetry [candidate] (7.898 ms) : 0, 7898
ProfilingAgent [baseline] (93.359 ms) : 0, 93359
ProfilingAgent [candidate] (95.49 ms) : 0, 95490
Profiling [baseline] (93.382 ms) : 0, 93382
Profiling [candidate] (95.514 ms) : 0, 95514
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-12-08T13:56:11 2024-12-08T14:03:10
git_branch master shurivich/debugger_system_tests
git_commit_date 1733503294 1733665508
git_commit_sha 0db6312 73955ae
release_version 1.44.0-SNAPSHOT~0db63127b0 1.44.0-SNAPSHOT~73955ae8ce
start_time 2024-12-08T13:55:58 2024-12-08T14:02:57
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1733666943 1733666943
ci_job_id 730131028 730131028
ci_pipeline_id 50515894 50515894
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0
    dateFormat X
    axisFormat %s
section baseline
no_agent (372.872 µs) : 353, 393
.   : milestone, 373,
iast (495.562 µs) : 474, 517
.   : milestone, 496,
iast_FULL (657.489 µs) : 636, 679
.   : milestone, 657,
iast_GLOBAL (511.553 µs) : 490, 533
.   : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (494.734 µs) : 473, 516
.   : milestone, 495,
iast_INACTIVE (453.293 µs) : 432, 475
.   : milestone, 453,
iast_TELEMETRY_OFF (482.709 µs) : 461, 504
.   : milestone, 483,
tracing (450.138 µs) : 429, 471
.   : milestone, 450,
section candidate
no_agent (376.334 µs) : 356, 397
.   : milestone, 376,
iast (494.748 µs) : 473, 516
.   : milestone, 495,
iast_FULL (655.76 µs) : 634, 677
.   : milestone, 656,
iast_GLOBAL (516.059 µs) : 494, 538
.   : milestone, 516,
iast_HARDCODED_SECRET_DISABLED (489.076 µs) : 467, 511
.   : milestone, 489,
iast_INACTIVE (453.526 µs) : 433, 474
.   : milestone, 454,
iast_TELEMETRY_OFF (482.888 µs) : 461, 505
.   : milestone, 483,
tracing (450.937 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 372.872 µs [353.003 µs, 392.74 µs] -
iast 495.562 µs [474.162 µs, 516.962 µs] 122.69 µs (32.9%)
iast_FULL 657.489 µs [635.965 µs, 679.012 µs] 284.617 µs (76.3%)
iast_GLOBAL 511.553 µs [490.237 µs, 532.868 µs] 138.681 µs (37.2%)
iast_HARDCODED_SECRET_DISABLED 494.734 µs [473.032 µs, 516.436 µs] 121.863 µs (32.7%)
iast_INACTIVE 453.293 µs [431.806 µs, 474.78 µs] 80.422 µs (21.6%)
iast_TELEMETRY_OFF 482.709 µs [461.242 µs, 504.176 µs] 109.837 µs (29.5%)
tracing 450.138 µs [429.157 µs, 471.118 µs] 77.266 µs (20.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.334 µs [355.924 µs, 396.745 µs] -
iast 494.748 µs [473.202 µs, 516.294 µs] 118.413 µs (31.5%)
iast_FULL 655.76 µs [634.396 µs, 677.123 µs] 279.425 µs (74.2%)
iast_GLOBAL 516.059 µs [494.41 µs, 537.709 µs] 139.725 µs (37.1%)
iast_HARDCODED_SECRET_DISABLED 489.076 µs [467.488 µs, 510.665 µs] 112.742 µs (30.0%)
iast_INACTIVE 453.526 µs [432.563 µs, 474.489 µs] 77.192 µs (20.5%)
iast_TELEMETRY_OFF 482.888 µs [461.007 µs, 504.77 µs] 106.554 µs (28.3%)
tracing 450.937 µs [429.936 µs, 471.938 µs] 74.603 µs (19.8%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.364 ms) : 1344, 1384
.   : milestone, 1364,
appsec (1.751 ms) : 1727, 1775
.   : milestone, 1751,
appsec_no_iast (1.752 ms) : 1727, 1777
.   : milestone, 1752,
iast (1.484 ms) : 1461, 1508
.   : milestone, 1484,
profiling (1.536 ms) : 1511, 1561
.   : milestone, 1536,
tracing (1.485 ms) : 1460, 1511
.   : milestone, 1485,
section candidate
no_agent (1.348 ms) : 1328, 1368
.   : milestone, 1348,
appsec (1.779 ms) : 1754, 1804
.   : milestone, 1779,
appsec_no_iast (1.764 ms) : 1741, 1788
.   : milestone, 1764,
iast (1.502 ms) : 1479, 1524
.   : milestone, 1502,
profiling (1.505 ms) : 1481, 1528
.   : milestone, 1505,
tracing (1.483 ms) : 1457, 1508
.   : milestone, 1483,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.364 ms [1.344 ms, 1.384 ms] -
appsec 1.751 ms [1.727 ms, 1.775 ms] 387.468 µs (28.4%)
appsec_no_iast 1.752 ms [1.727 ms, 1.777 ms] 387.921 µs (28.4%)
iast 1.484 ms [1.461 ms, 1.508 ms] 120.475 µs (8.8%)
profiling 1.536 ms [1.511 ms, 1.561 ms] 172.115 µs (12.6%)
tracing 1.485 ms [1.46 ms, 1.511 ms] 121.502 µs (8.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.348 ms [1.328 ms, 1.368 ms] -
appsec 1.779 ms [1.754 ms, 1.804 ms] 430.857 µs (32.0%)
appsec_no_iast 1.764 ms [1.741 ms, 1.788 ms] 416.579 µs (30.9%)
iast 1.502 ms [1.479 ms, 1.524 ms] 153.631 µs (11.4%)
profiling 1.505 ms [1.481 ms, 1.528 ms] 156.684 µs (11.6%)
tracing 1.483 ms [1.457 ms, 1.508 ms] 134.708 µs (10.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master shurivich/debugger_system_tests
git_commit_date 1733503294 1733665508
git_commit_sha 0db6312 73955ae
release_version 1.44.0-SNAPSHOT~0db63127b0 1.44.0-SNAPSHOT~73955ae8ce
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1733667558 1733667558
ci_job_id 730131029 730131029
ci_pipeline_id 50515894 50515894
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (2.349 ms) : 2308, 2390
.   : milestone, 2349,
iast (2.096 ms) : 2043, 2148
.   : milestone, 2096,
iast_GLOBAL (2.136 ms) : 2083, 2189
.   : milestone, 2136,
profiling (1.974 ms) : 1931, 2017
.   : milestone, 1974,
tracing (1.935 ms) : 1895, 1976
.   : milestone, 1935,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.354 ms) : 2313, 2396
.   : milestone, 2354,
iast (2.092 ms) : 2040, 2145
.   : milestone, 2092,
iast_GLOBAL (2.138 ms) : 2085, 2191
.   : milestone, 2138,
profiling (1.97 ms) : 1927, 2012
.   : milestone, 1970,
tracing (1.927 ms) : 1887, 1967
.   : milestone, 1927,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 2.349 ms [2.308 ms, 2.39 ms] 882.428 µs (60.2%)
iast 2.096 ms [2.043 ms, 2.148 ms] 629.004 µs (42.9%)
iast_GLOBAL 2.136 ms [2.083 ms, 2.189 ms] 669.686 µs (45.7%)
profiling 1.974 ms [1.931 ms, 2.017 ms] 507.57 µs (34.6%)
tracing 1.935 ms [1.895 ms, 1.976 ms] 468.837 µs (32.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.354 ms [2.313 ms, 2.396 ms] 883.996 µs (60.1%)
iast 2.092 ms [2.04 ms, 2.145 ms] 621.994 µs (42.3%)
iast_GLOBAL 2.138 ms [2.085 ms, 2.191 ms] 667.639 µs (45.4%)
profiling 1.97 ms [1.927 ms, 2.012 ms] 499.081 µs (33.9%)
tracing 1.927 ms [1.887 ms, 1.967 ms] 456.695 µs (31.1%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.44.0-SNAPSHOT~73955ae8ce, baseline=1.44.0-SNAPSHOT~0db63127b0
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
appsec (15.144 s) : 15144000, 15144000
.   : milestone, 15144000,
iast (18.558 s) : 18558000, 18558000
.   : milestone, 18558000,
iast_GLOBAL (17.754 s) : 17754000, 17754000
.   : milestone, 17754000,
profiling (14.869 s) : 14869000, 14869000
.   : milestone, 14869000,
tracing (14.851 s) : 14851000, 14851000
.   : milestone, 14851000,
section candidate
no_agent (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
appsec (15.183 s) : 15183000, 15183000
.   : milestone, 15183000,
iast (18.992 s) : 18992000, 18992000
.   : milestone, 18992000,
iast_GLOBAL (17.757 s) : 17757000, 17757000
.   : milestone, 17757000,
profiling (14.946 s) : 14946000, 14946000
.   : milestone, 14946000,
tracing (15.305 s) : 15305000, 15305000
.   : milestone, 15305000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.412 s [15.412 s, 15.412 s] -
appsec 15.144 s [15.144 s, 15.144 s] -268.0 ms (-1.7%)
iast 18.558 s [18.558 s, 18.558 s] 3.146 s (20.4%)
iast_GLOBAL 17.754 s [17.754 s, 17.754 s] 2.342 s (15.2%)
profiling 14.869 s [14.869 s, 14.869 s] -543.0 ms (-3.5%)
tracing 14.851 s [14.851 s, 14.851 s] -561.0 ms (-3.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.965 s [14.965 s, 14.965 s] -
appsec 15.183 s [15.183 s, 15.183 s] 218.0 ms (1.5%)
iast 18.992 s [18.992 s, 18.992 s] 4.027 s (26.9%)
iast_GLOBAL 17.757 s [17.757 s, 17.757 s] 2.792 s (18.7%)
profiling 14.946 s [14.946 s, 14.946 s] -19.0 ms (-0.1%)
tracing 15.305 s [15.305 s, 15.305 s] 340.0 ms (2.3%)

@shurivich shurivich force-pushed the shurivich/debugger_system_tests branch from 3b194aa to 98f8b5a Compare December 8, 2024 13:09
@shurivich shurivich force-pushed the shurivich/debugger_system_tests branch from 98f8b5a to 73955ae Compare December 8, 2024 13:45
@shurivich shurivich marked this pull request as ready for review December 8, 2024 17:29
@shurivich shurivich requested a review from a team as a code owner December 8, 2024 17:29
@shurivich shurivich requested review from amarziali and jpbempel and removed request for a team and amarziali December 8, 2024 17:29
@shurivich shurivich changed the title [Debugger] Fix system tests CI [Debugger] Fix system tests CI logs upload Dec 8, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 8, 2024 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Remove the tag from the pull request title

If you need help, please check our contributing guidelines.

@shurivich shurivich changed the title [Debugger] Fix system tests CI logs upload [Debugger] Fix system tests logs upload Dec 8, 2024
@shurivich shurivich changed the title [Debugger] Fix system tests logs upload Fix debugger system tests logs Dec 8, 2024
@shurivich shurivich changed the title Fix debugger system tests logs [Debugger] Fix system tests CI Dec 8, 2024
@shurivich shurivich added the tag: no release notes Changes to exclude from release notes label Dec 8, 2024
@shurivich shurivich changed the title [Debugger] Fix system tests CI Fix debugger system tests CI logs upload Dec 8, 2024
@shurivich shurivich merged commit b278d9e into master Dec 9, 2024
151 of 156 checks passed
@shurivich shurivich deleted the shurivich/debugger_system_tests branch December 9, 2024 11:55
@github-actions github-actions bot added this to the 1.44.0 milestone Dec 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@jpbempel jpbempel jpbempel approved these changes

@smola smola smola approved these changes

Assignees

@shurivich shurivich

Labels
comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.44.0
Development

Successfully merging this pull request may close these issues.
3 participants
@shurivich @smola @jpbempel