Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Decouple gradle JDK from compile/test JDK #7506

Draft
wants to merge 13 commits into
base: master
Choose a base branch
from
Draft

Decouple gradle JDK from compile/test JDK #7506

wants to merge 13 commits into from

Conversation

smola
Copy link
Member

@smola smola commented Aug 26, 2024 •
edited by jira bot
Loading

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APMJAVA-1342

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Aug 26, 2024
@smola smola force-pushed the smola/gradle-java11 branch from dc1fa6e to 702851a Compare August 30, 2024 20:49
@pr-commenter
Copy link

pr-commenter bot commented Aug 30, 2024 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-java11
git_commit_date 1737124507 1737129767
git_commit_sha fbb36f9 22e3221
release_version 1.46.0-SNAPSHOT~fbb36f9b5b 1.46.0-SNAPSHOT~22e3221d0f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737132105 1737132105
ci_job_id 771028336 771028336
ci_pipeline_id 53329609 53329609
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053016
Total [baseline] (10.471 s) : 0, 10471152
Agent [candidate] (1.056 s) : 0, 1056222
Total [candidate] (10.514 s) : 0, 10514017
section appsec
Agent [baseline] (1.194 s) : 0, 1193773
Total [baseline] (10.771 s) : 0, 10770874
Agent [candidate] (1.195 s) : 0, 1194917
Total [candidate] (10.705 s) : 0, 10705404
section iast
Agent [baseline] (1.188 s) : 0, 1188461
Total [baseline] (10.946 s) : 0, 10945961
Agent [candidate] (1.183 s) : 0, 1182598
Total [candidate] (10.959 s) : 0, 10959008
section profiling
Agent [baseline] (1.26 s) : 0, 1259943
Total [baseline] (10.738 s) : 0, 10738410
Agent [candidate] (1.27 s) : 0, 1270457
Total [candidate] (10.928 s) : 0, 10928176
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.194 s 140.758 ms (13.4%)
Agent iast 1.188 s 135.445 ms (12.9%)
Agent profiling 1.26 s 206.927 ms (19.7%)
Total tracing 10.471 s -
Total appsec 10.771 s 299.722 ms (2.9%)
Total iast 10.946 s 474.809 ms (4.5%)
Total profiling 10.738 s 267.258 ms (2.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.195 s 138.695 ms (13.1%)
Agent iast 1.183 s 126.376 ms (12.0%)
Agent profiling 1.27 s 214.235 ms (20.3%)
Total tracing 10.514 s -
Total appsec 10.705 s 191.387 ms (1.8%)
Total iast 10.959 s 444.991 ms (4.2%)
Total profiling 10.928 s 414.159 ms (3.9%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (711.414 ms) : 0, 711414
BytebuddyAgent [candidate] (714.289 ms) : 0, 714289
GlobalTracer [baseline] (255.344 ms) : 0, 255344
GlobalTracer [candidate] (255.78 ms) : 0, 255780
AppSec [baseline] (57.032 ms) : 0, 57032
AppSec [candidate] (56.215 ms) : 0, 56215
Remote Config [baseline] (736.566 µs) : 0, 737
Remote Config [candidate] (746.297 µs) : 0, 746
Telemetry [baseline] (13.546 ms) : 0, 13546
Telemetry [candidate] (14.186 ms) : 0, 14186
section appsec
BytebuddyAgent [baseline] (734.891 ms) : 0, 734891
BytebuddyAgent [candidate] (735.645 ms) : 0, 735645
GlobalTracer [baseline] (254.051 ms) : 0, 254051
GlobalTracer [candidate] (253.929 ms) : 0, 253929
AppSec [baseline] (171.154 ms) : 0, 171154
AppSec [candidate] (171.686 ms) : 0, 171686
Remote Config [baseline] (678.959 µs) : 0, 679
Remote Config [candidate] (667.069 µs) : 0, 667
Telemetry [baseline] (8.252 ms) : 0, 8252
Telemetry [candidate] (8.224 ms) : 0, 8224
IAST [baseline] (19.429 ms) : 0, 19429
IAST [candidate] (19.445 ms) : 0, 19445
section iast
BytebuddyAgent [baseline] (837.433 ms) : 0, 837433
BytebuddyAgent [candidate] (831.631 ms) : 0, 831631
GlobalTracer [baseline] (246.504 ms) : 0, 246504
GlobalTracer [candidate] (246.622 ms) : 0, 246622
AppSec [baseline] (58.16 ms) : 0, 58160
AppSec [candidate] (58.056 ms) : 0, 58056
Remote Config [baseline] (686.959 µs) : 0, 687
Remote Config [candidate] (673.096 µs) : 0, 673
Telemetry [baseline] (8.836 ms) : 0, 8836
Telemetry [candidate] (8.814 ms) : 0, 8814
IAST [baseline] (21.696 ms) : 0, 21696
IAST [candidate] (21.741 ms) : 0, 21741
section profiling
BytebuddyAgent [baseline] (706.625 ms) : 0, 706625
BytebuddyAgent [candidate] (714.104 ms) : 0, 714104
GlobalTracer [baseline] (350.337 ms) : 0, 350337
GlobalTracer [candidate] (352.629 ms) : 0, 352629
AppSec [baseline] (55.067 ms) : 0, 55067
AppSec [candidate] (54.64 ms) : 0, 54640
Remote Config [baseline] (703.899 µs) : 0, 704
Remote Config [candidate] (711.939 µs) : 0, 712
Telemetry [baseline] (8.863 ms) : 0, 8863
Telemetry [candidate] (8.991 ms) : 0, 8991
ProfilingAgent [baseline] (96.271 ms) : 0, 96271
ProfilingAgent [candidate] (96.7 ms) : 0, 96700
Profiling [baseline] (96.296 ms) : 0, 96296
Profiling [candidate] (96.724 ms) : 0, 96724
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059538
Total [baseline] (8.637 s) : 0, 8637020
Agent [candidate] (1.055 s) : 0, 1055394
Total [candidate] (8.606 s) : 0, 8606095
section iast
Agent [baseline] (1.187 s) : 0, 1187456
Total [baseline] (9.222 s) : 0, 9222455
Agent [candidate] (1.195 s) : 0, 1194636
Total [candidate] (9.209 s) : 0, 9209459
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.18 s) : 0, 1180123
Total [baseline] (9.161 s) : 0, 9160680
Agent [candidate] (1.182 s) : 0, 1182020
Total [candidate] (9.158 s) : 0, 9157935
section iast_TELEMETRY_OFF
Agent [baseline] (1.187 s) : 0, 1187297
Total [baseline] (9.248 s) : 0, 9247584
Agent [candidate] (1.176 s) : 0, 1175852
Total [candidate] (9.168 s) : 0, 9168001
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.187 s 127.918 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 120.585 ms (11.4%)
Agent iast_TELEMETRY_OFF 1.187 s 127.76 ms (12.1%)
Total tracing 8.637 s -
Total iast 9.222 s 585.435 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.161 s 523.66 ms (6.1%)
Total iast_TELEMETRY_OFF 9.248 s 610.564 ms (7.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.195 s 139.242 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.182 s 126.626 ms (12.0%)
Agent iast_TELEMETRY_OFF 1.176 s 120.458 ms (11.4%)
Total tracing 8.606 s -
Total iast 9.209 s 603.363 ms (7.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.158 s 551.84 ms (6.4%)
Total iast_TELEMETRY_OFF 9.168 s 561.906 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.684 ms) : 0, 717684
BytebuddyAgent [candidate] (716.699 ms) : 0, 716699
GlobalTracer [baseline] (256.814 ms) : 0, 256814
GlobalTracer [candidate] (256.358 ms) : 0, 256358
AppSec [baseline] (55.692 ms) : 0, 55692
AppSec [candidate] (55.692 ms) : 0, 55692
Remote Config [baseline] (750.33 µs) : 0, 750
Remote Config [candidate] (735.705 µs) : 0, 736
Telemetry [baseline] (13.601 ms) : 0, 13601
Telemetry [candidate] (10.871 ms) : 0, 10871
section iast
BytebuddyAgent [baseline] (836.97 ms) : 0, 836970
BytebuddyAgent [candidate] (840.206 ms) : 0, 840206
GlobalTracer [baseline] (246.464 ms) : 0, 246464
GlobalTracer [candidate] (249.558 ms) : 0, 249558
AppSec [baseline] (58.178 ms) : 0, 58178
AppSec [candidate] (58.475 ms) : 0, 58475
Remote Config [baseline] (674.159 µs) : 0, 674
Remote Config [candidate] (688.996 µs) : 0, 689
Telemetry [baseline] (8.79 ms) : 0, 8790
Telemetry [candidate] (8.878 ms) : 0, 8878
IAST [baseline] (21.311 ms) : 0, 21311
IAST [candidate] (21.697 ms) : 0, 21697
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (830.101 ms) : 0, 830101
BytebuddyAgent [candidate] (831.126 ms) : 0, 831126
GlobalTracer [baseline] (245.941 ms) : 0, 245941
GlobalTracer [candidate] (246.361 ms) : 0, 246361
AppSec [baseline] (58.132 ms) : 0, 58132
AppSec [candidate] (58.459 ms) : 0, 58459
Remote Config [baseline] (671.077 µs) : 0, 671
Remote Config [candidate] (676.097 µs) : 0, 676
Telemetry [baseline] (8.838 ms) : 0, 8838
Telemetry [candidate] (8.827 ms) : 0, 8827
IAST [baseline] (21.451 ms) : 0, 21451
IAST [candidate] (21.524 ms) : 0, 21524
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.905 ms) : 0, 834905
BytebuddyAgent [candidate] (827.052 ms) : 0, 827052
GlobalTracer [baseline] (247.775 ms) : 0, 247775
GlobalTracer [candidate] (246.195 ms) : 0, 246195
AppSec [baseline] (58.725 ms) : 0, 58725
AppSec [candidate] (57.587 ms) : 0, 57587
Remote Config [baseline] (672.188 µs) : 0, 672
Remote Config [candidate] (671.221 µs) : 0, 671
Telemetry [baseline] (8.819 ms) : 0, 8819
Telemetry [candidate] (8.636 ms) : 0, 8636
IAST [baseline] (21.338 ms) : 0, 21338
IAST [candidate] (20.716 ms) : 0, 20716
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-17T16:11:45 2025-01-17T16:18:53
git_branch master smola/gradle-java11
git_commit_date 1737124507 1737129767
git_commit_sha fbb36f9 22e3221
release_version 1.46.0-SNAPSHOT~fbb36f9b5b 1.46.0-SNAPSHOT~22e3221d0f
start_time 2025-01-17T16:11:31 2025-01-17T16:18:38
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737131092 1737131092
ci_job_id 771028337 771028337
ci_pipeline_id 53329609 53329609
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.17 µs) : 363, 403
.   : milestone, 383,
iast (510.465 µs) : 489, 532
.   : milestone, 510,
iast_FULL (746.854 µs) : 725, 769
.   : milestone, 747,
iast_GLOBAL (555.867 µs) : 534, 578
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (520.309 µs) : 499, 542
.   : milestone, 520,
iast_INACTIVE (464.173 µs) : 442, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (495.15 µs) : 474, 516
.   : milestone, 495,
tracing (456.038 µs) : 435, 477
.   : milestone, 456,
section candidate
no_agent (382.335 µs) : 362, 402
.   : milestone, 382,
iast (515.402 µs) : 494, 537
.   : milestone, 515,
iast_FULL (750.427 µs) : 728, 773
.   : milestone, 750,
iast_GLOBAL (555.148 µs) : 534, 577
.   : milestone, 555,
iast_HARDCODED_SECRET_DISABLED (519.266 µs) : 497, 541
.   : milestone, 519,
iast_INACTIVE (465.226 µs) : 443, 487
.   : milestone, 465,
iast_TELEMETRY_OFF (498.194 µs) : 477, 520
.   : milestone, 498,
tracing (458.489 µs) : 438, 479
.   : milestone, 458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.17 µs [363.208 µs, 403.132 µs] -
iast 510.465 µs [488.643 µs, 532.288 µs] 127.296 µs (33.2%)
iast_FULL 746.854 µs [724.848 µs, 768.861 µs] 363.685 µs (94.9%)
iast_GLOBAL 555.867 µs [534.157 µs, 577.576 µs] 172.697 µs (45.1%)
iast_HARDCODED_SECRET_DISABLED 520.309 µs [498.625 µs, 541.992 µs] 137.139 µs (35.8%)
iast_INACTIVE 464.173 µs [442.225 µs, 486.121 µs] 81.004 µs (21.1%)
iast_TELEMETRY_OFF 495.15 µs [473.857 µs, 516.444 µs] 111.981 µs (29.2%)
tracing 456.038 µs [435.195 µs, 476.881 µs] 72.869 µs (19.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.335 µs [362.305 µs, 402.366 µs] -
iast 515.402 µs [493.647 µs, 537.158 µs] 133.067 µs (34.8%)
iast_FULL 750.427 µs [728.348 µs, 772.506 µs] 368.092 µs (96.3%)
iast_GLOBAL 555.148 µs [533.672 µs, 576.624 µs] 172.813 µs (45.2%)
iast_HARDCODED_SECRET_DISABLED 519.266 µs [497.067 µs, 541.466 µs] 136.931 µs (35.8%)
iast_INACTIVE 465.226 µs [443.406 µs, 487.045 µs] 82.891 µs (21.7%)
iast_TELEMETRY_OFF 498.194 µs [476.777 µs, 519.611 µs] 115.859 µs (30.3%)
tracing 458.489 µs [437.637 µs, 479.342 µs] 76.154 µs (19.9%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.383 ms) : 1364, 1402
.   : milestone, 1383,
appsec (1.751 ms) : 1727, 1775
.   : milestone, 1751,
appsec_no_iast (1.775 ms) : 1751, 1799
.   : milestone, 1775,
iast (1.53 ms) : 1506, 1553
.   : milestone, 1530,
profiling (1.544 ms) : 1519, 1569
.   : milestone, 1544,
tracing (1.512 ms) : 1488, 1536
.   : milestone, 1512,
section candidate
no_agent (1.356 ms) : 1337, 1376
.   : milestone, 1356,
appsec (1.755 ms) : 1731, 1779
.   : milestone, 1755,
appsec_no_iast (1.78 ms) : 1757, 1803
.   : milestone, 1780,
iast (1.499 ms) : 1474, 1523
.   : milestone, 1499,
profiling (1.517 ms) : 1493, 1540
.   : milestone, 1517,
tracing (1.51 ms) : 1486, 1535
.   : milestone, 1510,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.383 ms [1.364 ms, 1.402 ms] -
appsec 1.751 ms [1.727 ms, 1.775 ms] 367.846 µs (26.6%)
appsec_no_iast 1.775 ms [1.751 ms, 1.799 ms] 392.167 µs (28.4%)
iast 1.53 ms [1.506 ms, 1.553 ms] 146.602 µs (10.6%)
profiling 1.544 ms [1.519 ms, 1.569 ms] 160.787 µs (11.6%)
tracing 1.512 ms [1.488 ms, 1.536 ms] 128.647 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.337 ms, 1.376 ms] -
appsec 1.755 ms [1.731 ms, 1.779 ms] 398.957 µs (29.4%)
appsec_no_iast 1.78 ms [1.757 ms, 1.803 ms] 423.702 µs (31.2%)
iast 1.499 ms [1.474 ms, 1.523 ms] 142.627 µs (10.5%)
profiling 1.517 ms [1.493 ms, 1.54 ms] 160.37 µs (11.8%)
tracing 1.51 ms [1.486 ms, 1.535 ms] 154.18 µs (11.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-java11
git_commit_date 1737124507 1737129767
git_commit_sha fbb36f9 22e3221
release_version 1.46.0-SNAPSHOT~fbb36f9b5b 1.46.0-SNAPSHOT~22e3221d0f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737131643 1737131643
ci_job_id 771028338 771028338
ci_pipeline_id 53329609 53329609
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.543 s) : 15543000, 15543000
.   : milestone, 15543000,
appsec (15.226 s) : 15226000, 15226000
.   : milestone, 15226000,
iast (18.592 s) : 18592000, 18592000
.   : milestone, 18592000,
iast_GLOBAL (18.102 s) : 18102000, 18102000
.   : milestone, 18102000,
profiling (14.97 s) : 14970000, 14970000
.   : milestone, 14970000,
tracing (15.101 s) : 15101000, 15101000
.   : milestone, 15101000,
section candidate
no_agent (14.805 s) : 14805000, 14805000
.   : milestone, 14805000,
appsec (14.694 s) : 14694000, 14694000
.   : milestone, 14694000,
iast (18.752 s) : 18752000, 18752000
.   : milestone, 18752000,
iast_GLOBAL (18.143 s) : 18143000, 18143000
.   : milestone, 18143000,
profiling (15.043 s) : 15043000, 15043000
.   : milestone, 15043000,
tracing (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.543 s [15.543 s, 15.543 s] -
appsec 15.226 s [15.226 s, 15.226 s] -317.0 ms (-2.0%)
iast 18.592 s [18.592 s, 18.592 s] 3.049 s (19.6%)
iast_GLOBAL 18.102 s [18.102 s, 18.102 s] 2.559 s (16.5%)
profiling 14.97 s [14.97 s, 14.97 s] -573.0 ms (-3.7%)
tracing 15.101 s [15.101 s, 15.101 s] -442.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.805 s [14.805 s, 14.805 s] -
appsec 14.694 s [14.694 s, 14.694 s] -111.0 ms (-0.7%)
iast 18.752 s [18.752 s, 18.752 s] 3.947 s (26.7%)
iast_GLOBAL 18.143 s [18.143 s, 18.143 s] 3.338 s (22.5%)
profiling 15.043 s [15.043 s, 15.043 s] 238.0 ms (1.6%)
tracing 15.001 s [15.001 s, 15.001 s] 196.0 ms (1.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~22e3221d0f, baseline=1.46.0-SNAPSHOT~fbb36f9b5b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.349 ms) : 2306, 2393
.   : milestone, 2349,
iast (2.098 ms) : 2044, 2153
.   : milestone, 2098,
iast_GLOBAL (2.146 ms) : 2091, 2201
.   : milestone, 2146,
profiling (1.966 ms) : 1921, 2011
.   : milestone, 1966,
tracing (1.942 ms) : 1900, 1984
.   : milestone, 1942,
section candidate
no_agent (1.465 ms) : 1454, 1477
.   : milestone, 1465,
appsec (2.352 ms) : 2309, 2395
.   : milestone, 2352,
iast (2.093 ms) : 2038, 2147
.   : milestone, 2093,
iast_GLOBAL (2.141 ms) : 2086, 2196
.   : milestone, 2141,
profiling (1.949 ms) : 1905, 1992
.   : milestone, 1949,
tracing (1.932 ms) : 1890, 1973
.   : milestone, 1932,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.349 ms [2.306 ms, 2.393 ms] 880.236 µs (59.9%)
iast 2.098 ms [2.044 ms, 2.153 ms] 629.417 µs (42.8%)
iast_GLOBAL 2.146 ms [2.091 ms, 2.201 ms] 676.922 µs (46.1%)
profiling 1.966 ms [1.921 ms, 2.011 ms] 496.791 µs (33.8%)
tracing 1.942 ms [1.9 ms, 1.984 ms] 472.778 µs (32.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.465 ms [1.454 ms, 1.477 ms] -
appsec 2.352 ms [2.309 ms, 2.395 ms] 886.751 µs (60.5%)
iast 2.093 ms [2.038 ms, 2.147 ms] 627.436 µs (42.8%)
iast_GLOBAL 2.141 ms [2.086 ms, 2.196 ms] 676.012 µs (46.1%)
profiling 1.949 ms [1.905 ms, 1.992 ms] 483.354 µs (33.0%)
tracing 1.932 ms [1.89 ms, 1.973 ms] 466.356 µs (31.8%)

@smola smola force-pushed the smola/gradle-java11 branch from 702851a to d1abf3b Compare September 23, 2024 11:18
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 1, 2025

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

@github-actions github-actions bot added the tag: stale Stale pull requests label Jan 1, 2025
@smola smola force-pushed the smola/gradle-java11 branch 2 times, most recently from 0e79c09 to 0a43968 Compare January 15, 2025 15:19
@pr-commenter
Copy link

pr-commenter bot commented Jan 15, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1737130356 1737130726
end_time 2025-01-17T16:13:53 2025-01-17T16:20:04
git_branch master smola/gradle-java11
git_commit_sha fbb36f9 22e3221
start_time 2025-01-17T16:12:37 2025-01-17T16:18:47
See matching parameters
Baseline Candidate
ci_job_id 771028342 771028342
ci_pipeline_id 53329609 53329609
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1737129767 1737129767

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 5 metrics, 5 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+650.531µs; +681.779µs] or [+6.586%; +6.902%]		 worse
[+655.598µs; +724.897µs] or [+6.538%; +7.229%]		 worse
[+626.184µs; +730.216µs] or [+6.187%; +7.215%]		 worse
[+367.013µs; +1034.458µs] or [+3.487%; +9.827%]		 worse
[-7.158op/s; -4.588op/s] or [-7.301%; -4.680%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-22.392µs; +26.134µs] or [-8.263%; +9.644%]		 unstable
[-32.414µs; +40.857µs] or [-10.493%; +13.226%]		 unstable
[-44.325µs; +53.769µs] or [-13.682%; +16.597%]		 unstable
[-97.542µs; +107.426µs] or [-16.847%; +18.554%]		 same
scenario:basic same same same unstable
[-25.522µs; +47.827µs] or [-4.839%; +9.068%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (308.908 µs) : 275, 343
.   : milestone, 309,
basic (316.53 µs) : 308, 325
.   : milestone, 317,
loop (10.027 ms) : 10004, 10051
.   : milestone, 10027,
section candidate
noprobe (313.13 µs) : 278, 349
.   : milestone, 313,
basic (312.44 µs) : 304, 320
.   : milestone, 312,
loop (10.718 ms) : 10678, 10757
.   : milestone, 10718,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 308.908 µs [274.593 µs, 343.224 µs]
basic 316.53 µs [308.5 µs, 324.56 µs]
loop 10.027 ms [10.004 ms, 10.051 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 313.13 µs [277.626 µs, 348.634 µs]
basic 312.44 µs [304.46 µs, 320.42 µs]
loop 10.718 ms [10.678 ms, 10.757 ms]

@smola smola force-pushed the smola/gradle-java11 branch from 0a43968 to 40c09e8 Compare January 17, 2025 11:07
@smola smola force-pushed the smola/gradle-java11 branch from 40c09e8 to 7c20689 Compare January 17, 2025 15:52
@smola
Squashed commit of the following:
22e3221 
commit f2a064b
Author: Santiago Mola <santiago.mola@datadoghq.com>
Date:   Fri Jan 17 12:03:48 2025 +0100

    Disable selenium latestDepTest until fixed

commit f0a832f
Author: Santiago Mola <santiago.mola@datadoghq.com>
Date:   Thu Jan 16 23:06:21 2025 +0100

    Decouple test JDK and gradle JDK in selenium latestDepTest
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: stale Stale pull requests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@smola