Decouple test JDK and gradle JDK in karate latestDepTest #8234

smola · 2025-01-16T21:21:10Z

What Does This Do

Avoid using the version of the JDK used to run gradle (always 8 in CI) to select karate version to test. Before this PR, test tested karate 1.0.0, and latestDepTest always tested karate 1.3.1 and never 1.4.0+ (in CI). Now:

test -> 1.0.0
karate131Test -> 1.3.1
latestDepTest -> 1.4.0+

Motivation

Part of fixes to decouple the JDK used for compile/test from the one used by gradle.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

dd-java-agent/instrumentation/karate/build.gradle

pr-commenter · 2025-01-16T22:00:36Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/karate-latest-jdk
git_commit_date	1737044223	1737062238
git_commit_sha	`f1d359b`	`4e03bf9`
release_version	1.46.0-SNAPSHOT~f1d359b93f	1.46.0-SNAPSHOT~4e03bf9bad

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737064655	1737064655
ci_job_id	769879689	769879689
ci_pipeline_id	53246565	53246565
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055625
Total [baseline] (10.453 s) : 0, 10452932
Agent [candidate] (1.056 s) : 0, 1056491
Total [candidate] (10.5 s) : 0, 10500152
section appsec
Agent [baseline] (1.189 s) : 0, 1188588
Total [baseline] (10.687 s) : 0, 10686689
Agent [candidate] (1.189 s) : 0, 1189393
Total [candidate] (10.733 s) : 0, 10732533
section iast
Agent [baseline] (1.184 s) : 0, 1183608
Total [baseline] (10.982 s) : 0, 10982487
Agent [candidate] (1.191 s) : 0, 1190992
Total [candidate] (10.998 s) : 0, 10998303
section profiling
Agent [baseline] (1.253 s) : 0, 1252593
Total [baseline] (10.731 s) : 0, 10730610
Agent [candidate] (1.264 s) : 0, 1263606
Total [candidate] (10.889 s) : 0, 10889021

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	appsec	1.189 s	132.963 ms (12.6%)
Agent	iast	1.184 s	127.982 ms (12.1%)
Agent	profiling	1.253 s	196.968 ms (18.7%)
Total	tracing	10.453 s	-
Total	appsec	10.687 s	233.757 ms (2.2%)
Total	iast	10.982 s	529.556 ms (5.1%)
Total	profiling	10.731 s	277.678 ms (2.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	appsec	1.189 s	132.902 ms (12.6%)
Agent	iast	1.191 s	134.501 ms (12.7%)
Agent	profiling	1.264 s	207.115 ms (19.6%)
Total	tracing	10.5 s	-
Total	appsec	10.733 s	232.381 ms (2.2%)
Total	iast	10.998 s	498.151 ms (4.7%)
Total	profiling	10.889 s	388.869 ms (3.7%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.156 ms) : 0, 714156
BytebuddyAgent [candidate] (716.027 ms) : 0, 716027
GlobalTracer [baseline] (256.011 ms) : 0, 256011
GlobalTracer [candidate] (257.585 ms) : 0, 257585
AppSec [baseline] (56.125 ms) : 0, 56125
AppSec [candidate] (56.194 ms) : 0, 56194
Remote Config [baseline] (730.143 µs) : 0, 730
Remote Config [candidate] (725.85 µs) : 0, 726
Telemetry [baseline] (13.658 ms) : 0, 13658
Telemetry [candidate] (10.918 ms) : 0, 10918
section appsec
BytebuddyAgent [baseline] (730.957 ms) : 0, 730957
BytebuddyAgent [candidate] (730.997 ms) : 0, 730997
GlobalTracer [baseline] (252.883 ms) : 0, 252883
GlobalTracer [candidate] (253.18 ms) : 0, 253180
AppSec [baseline] (170.912 ms) : 0, 170912
AppSec [candidate] (170.132 ms) : 0, 170132
Remote Config [baseline] (662.236 µs) : 0, 662
Remote Config [candidate] (669.525 µs) : 0, 670
Telemetry [baseline] (8.229 ms) : 0, 8229
Telemetry [candidate] (8.965 ms) : 0, 8965
IAST [baseline] (20.023 ms) : 0, 20023
IAST [candidate] (20.95 ms) : 0, 20950
section iast
BytebuddyAgent [baseline] (832.135 ms) : 0, 832135
BytebuddyAgent [candidate] (838.213 ms) : 0, 838213
GlobalTracer [baseline] (247.095 ms) : 0, 247095
GlobalTracer [candidate] (248.419 ms) : 0, 248419
AppSec [baseline] (58.147 ms) : 0, 58147
AppSec [candidate] (58.126 ms) : 0, 58126
Remote Config [baseline] (687.123 µs) : 0, 687
Remote Config [candidate] (670.015 µs) : 0, 670
Telemetry [baseline] (8.929 ms) : 0, 8929
Telemetry [candidate] (8.786 ms) : 0, 8786
IAST [baseline] (21.551 ms) : 0, 21551
IAST [candidate] (21.588 ms) : 0, 21588
section profiling
BytebuddyAgent [baseline] (702.172 ms) : 0, 702172
BytebuddyAgent [candidate] (705.382 ms) : 0, 705382
GlobalTracer [baseline] (348.402 ms) : 0, 348402
GlobalTracer [candidate] (354.688 ms) : 0, 354688
AppSec [baseline] (54.885 ms) : 0, 54885
AppSec [candidate] (54.637 ms) : 0, 54637
Remote Config [baseline] (685.619 µs) : 0, 686
Remote Config [candidate] (684.843 µs) : 0, 685
Telemetry [baseline] (8.828 ms) : 0, 8828
Telemetry [candidate] (9.056 ms) : 0, 9056
ProfilingAgent [baseline] (95.708 ms) : 0, 95708
ProfilingAgent [candidate] (97.181 ms) : 0, 97181
Profiling [baseline] (95.737 ms) : 0, 95737
Profiling [candidate] (97.211 ms) : 0, 97211

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053789
Total [baseline] (8.621 s) : 0, 8621286
Agent [candidate] (1.056 s) : 0, 1055606
Total [candidate] (8.613 s) : 0, 8612770
section iast
Agent [baseline] (1.2 s) : 0, 1199846
Total [baseline] (9.277 s) : 0, 9276904
Agent [candidate] (1.185 s) : 0, 1185349
Total [candidate] (9.202 s) : 0, 9202133
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.191 s) : 0, 1190831
Total [baseline] (9.205 s) : 0, 9205074
Agent [candidate] (1.185 s) : 0, 1184650
Total [candidate] (9.151 s) : 0, 9151201
section iast_TELEMETRY_OFF
Agent [baseline] (1.175 s) : 0, 1175427
Total [baseline] (9.22 s) : 0, 9220461
Agent [candidate] (1.178 s) : 0, 1178233
Total [candidate] (9.193 s) : 0, 9193269

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.054 s	-
Agent	iast	1.2 s	146.057 ms (13.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.191 s	137.042 ms (13.0%)
Agent	iast_TELEMETRY_OFF	1.175 s	121.638 ms (11.5%)
Total	tracing	8.621 s	-
Total	iast	9.277 s	655.618 ms (7.6%)
Total	iast_HARDCODED_SECRET_DISABLED	9.205 s	583.787 ms (6.8%)
Total	iast_TELEMETRY_OFF	9.22 s	599.175 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.056 s	-
Agent	iast	1.185 s	129.743 ms (12.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.185 s	129.044 ms (12.2%)
Agent	iast_TELEMETRY_OFF	1.178 s	122.627 ms (11.6%)
Total	tracing	8.613 s	-
Total	iast	9.202 s	589.363 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.151 s	538.431 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.193 s	580.499 ms (6.7%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.304 ms) : 0, 714304
BytebuddyAgent [candidate] (713.409 ms) : 0, 713409
GlobalTracer [baseline] (255.652 ms) : 0, 255652
GlobalTracer [candidate] (256.144 ms) : 0, 256144
AppSec [baseline] (55.968 ms) : 0, 55968
AppSec [candidate] (55.994 ms) : 0, 55994
Remote Config [baseline] (719.939 µs) : 0, 720
Remote Config [candidate] (738.312 µs) : 0, 738
Telemetry [baseline] (12.131 ms) : 0, 12131
Telemetry [candidate] (14.238 ms) : 0, 14238
section iast
BytebuddyAgent [baseline] (844.204 ms) : 0, 844204
BytebuddyAgent [candidate] (834.036 ms) : 0, 834036
GlobalTracer [baseline] (249.861 ms) : 0, 249861
GlobalTracer [candidate] (247.229 ms) : 0, 247229
AppSec [baseline] (58.731 ms) : 0, 58731
AppSec [candidate] (58.059 ms) : 0, 58059
Remote Config [baseline] (707.766 µs) : 0, 708
Remote Config [candidate] (667.023 µs) : 0, 667
Telemetry [baseline] (9.095 ms) : 0, 9095
Telemetry [candidate] (8.809 ms) : 0, 8809
IAST [baseline] (22.132 ms) : 0, 22132
IAST [candidate] (21.528 ms) : 0, 21528
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.777 ms) : 0, 837777
BytebuddyAgent [candidate] (832.531 ms) : 0, 832531
GlobalTracer [baseline] (248.571 ms) : 0, 248571
GlobalTracer [candidate] (247.783 ms) : 0, 247783
AppSec [baseline] (58.352 ms) : 0, 58352
AppSec [candidate] (58.278 ms) : 0, 58278
Remote Config [baseline] (671.888 µs) : 0, 672
Remote Config [candidate] (670.409 µs) : 0, 670
Telemetry [baseline] (8.873 ms) : 0, 8873
Telemetry [candidate] (8.764 ms) : 0, 8764
IAST [baseline] (21.459 ms) : 0, 21459
IAST [candidate] (21.63 ms) : 0, 21630
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (825.987 ms) : 0, 825987
BytebuddyAgent [candidate] (828.269 ms) : 0, 828269
GlobalTracer [baseline] (246.301 ms) : 0, 246301
GlobalTracer [candidate] (247.015 ms) : 0, 247015
AppSec [baseline] (57.895 ms) : 0, 57895
AppSec [candidate] (57.792 ms) : 0, 57792
Remote Config [baseline] (679.232 µs) : 0, 679
Remote Config [candidate] (666.225 µs) : 0, 666
Telemetry [baseline] (8.673 ms) : 0, 8673
Telemetry [candidate] (8.659 ms) : 0, 8659
IAST [baseline] (21.032 ms) : 0, 21032
IAST [candidate] (20.798 ms) : 0, 20798

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-16T21:29:40	2025-01-16T21:36:43
git_branch	master	smola/karate-latest-jdk
git_commit_date	1737044223	1737062238
git_commit_sha	`f1d359b`	`4e03bf9`
release_version	1.46.0-SNAPSHOT~f1d359b93f	1.46.0-SNAPSHOT~4e03bf9bad
start_time	2025-01-16T21:29:26	2025-01-16T21:36:29

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737063763	1737063763
ci_job_id	769879690	769879690
ci_pipeline_id	53246565	53246565
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.355 ms) : 1334, 1375
.   : milestone, 1355,
appsec (1.775 ms) : 1752, 1798
.   : milestone, 1775,
appsec_no_iast (1.754 ms) : 1731, 1777
.   : milestone, 1754,
iast (1.495 ms) : 1470, 1520
.   : milestone, 1495,
profiling (1.518 ms) : 1494, 1543
.   : milestone, 1518,
tracing (1.485 ms) : 1460, 1510
.   : milestone, 1485,
section candidate
no_agent (1.368 ms) : 1348, 1387
.   : milestone, 1368,
appsec (1.761 ms) : 1737, 1786
.   : milestone, 1761,
appsec_no_iast (1.756 ms) : 1734, 1779
.   : milestone, 1756,
iast (1.501 ms) : 1476, 1525
.   : milestone, 1501,
profiling (1.577 ms) : 1542, 1612
.   : milestone, 1577,
tracing (1.481 ms) : 1456, 1506
.   : milestone, 1481,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.355 ms [1.334 ms, 1.375 ms]	-
appsec	1.775 ms [1.752 ms, 1.798 ms]	420.207 µs (31.0%)
appsec_no_iast	1.754 ms [1.731 ms, 1.777 ms]	399.147 µs (29.5%)
iast	1.495 ms [1.47 ms, 1.52 ms]	140.734 µs (10.4%)
profiling	1.518 ms [1.494 ms, 1.543 ms]	163.637 µs (12.1%)
tracing	1.485 ms [1.46 ms, 1.51 ms]	130.499 µs (9.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.368 ms [1.348 ms, 1.387 ms]	-
appsec	1.761 ms [1.737 ms, 1.786 ms]	393.813 µs (28.8%)
appsec_no_iast	1.756 ms [1.734 ms, 1.779 ms]	388.883 µs (28.4%)
iast	1.501 ms [1.476 ms, 1.525 ms]	133.208 µs (9.7%)
profiling	1.577 ms [1.542 ms, 1.612 ms]	209.327 µs (15.3%)
tracing	1.481 ms [1.456 ms, 1.506 ms]	113.673 µs (8.3%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.032 µs) : 359, 398
.   : milestone, 378,
iast (512.857 µs) : 490, 535
.   : milestone, 513,
iast_FULL (741.421 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (552.086 µs) : 531, 573
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (508.113 µs) : 486, 530
.   : milestone, 508,
iast_INACTIVE (460.288 µs) : 439, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (494.973 µs) : 473, 517
.   : milestone, 495,
tracing (460.386 µs) : 439, 481
.   : milestone, 460,
section candidate
no_agent (377.626 µs) : 358, 397
.   : milestone, 378,
iast (515.763 µs) : 493, 538
.   : milestone, 516,
iast_FULL (749.505 µs) : 728, 771
.   : milestone, 750,
iast_GLOBAL (553.636 µs) : 532, 575
.   : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (511.864 µs) : 490, 534
.   : milestone, 512,
iast_INACTIVE (452.667 µs) : 432, 474
.   : milestone, 453,
iast_TELEMETRY_OFF (498.379 µs) : 477, 520
.   : milestone, 498,
tracing (449.464 µs) : 429, 470
.   : milestone, 449,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.032 µs [358.525 µs, 397.54 µs]	-
iast	512.857 µs [490.218 µs, 535.496 µs]	134.825 µs (35.7%)
iast_FULL	741.421 µs [719.461 µs, 763.38 µs]	363.388 µs (96.1%)
iast_GLOBAL	552.086 µs [530.701 µs, 573.47 µs]	174.053 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED	508.113 µs [486.011 µs, 530.215 µs]	130.081 µs (34.4%)
iast_INACTIVE	460.288 µs [438.518 µs, 482.057 µs]	82.256 µs (21.8%)
iast_TELEMETRY_OFF	494.973 µs [473.325 µs, 516.62 µs]	116.94 µs (30.9%)
tracing	460.386 µs [439.359 µs, 481.413 µs]	82.354 µs (21.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	377.626 µs [357.811 µs, 397.442 µs]	-
iast	515.763 µs [493.384 µs, 538.141 µs]	138.137 µs (36.6%)
iast_FULL	749.505 µs [727.775 µs, 771.234 µs]	371.879 µs (98.5%)
iast_GLOBAL	553.636 µs [532.156 µs, 575.115 µs]	176.009 µs (46.6%)
iast_HARDCODED_SECRET_DISABLED	511.864 µs [489.969 µs, 533.76 µs]	134.238 µs (35.5%)
iast_INACTIVE	452.667 µs [431.501 µs, 473.832 µs]	75.041 µs (19.9%)
iast_TELEMETRY_OFF	498.379 µs [476.71 µs, 520.047 µs]	120.752 µs (32.0%)
tracing	449.464 µs [429.065 µs, 469.863 µs]	71.838 µs (19.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/karate-latest-jdk
git_commit_date	1737044223	1737062238
git_commit_sha	`f1d359b`	`4e03bf9`
release_version	1.46.0-SNAPSHOT~f1d359b93f	1.46.0-SNAPSHOT~4e03bf9bad

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1737064334	1737064334
ci_job_id	769879691	769879691
ci_pipeline_id	53246565	53246565
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.242 s) : 15242000, 15242000
.   : milestone, 15242000,
appsec (15.079 s) : 15079000, 15079000
.   : milestone, 15079000,
iast (18.999 s) : 18999000, 18999000
.   : milestone, 18999000,
iast_GLOBAL (17.736 s) : 17736000, 17736000
.   : milestone, 17736000,
profiling (15.79 s) : 15790000, 15790000
.   : milestone, 15790000,
tracing (14.985 s) : 14985000, 14985000
.   : milestone, 14985000,
section candidate
no_agent (15.075 s) : 15075000, 15075000
.   : milestone, 15075000,
appsec (15.171 s) : 15171000, 15171000
.   : milestone, 15171000,
iast (18.894 s) : 18894000, 18894000
.   : milestone, 18894000,
iast_GLOBAL (18.008 s) : 18008000, 18008000
.   : milestone, 18008000,
profiling (15.175 s) : 15175000, 15175000
.   : milestone, 15175000,
tracing (15.281 s) : 15281000, 15281000
.   : milestone, 15281000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.242 s [15.242 s, 15.242 s]	-
appsec	15.079 s [15.079 s, 15.079 s]	-163.0 ms (-1.1%)
iast	18.999 s [18.999 s, 18.999 s]	3.757 s (24.6%)
iast_GLOBAL	17.736 s [17.736 s, 17.736 s]	2.494 s (16.4%)
profiling	15.79 s [15.79 s, 15.79 s]	548.0 ms (3.6%)
tracing	14.985 s [14.985 s, 14.985 s]	-257.0 ms (-1.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.075 s [15.075 s, 15.075 s]	-
appsec	15.171 s [15.171 s, 15.171 s]	96.0 ms (0.6%)
iast	18.894 s [18.894 s, 18.894 s]	3.819 s (25.3%)
iast_GLOBAL	18.008 s [18.008 s, 18.008 s]	2.933 s (19.5%)
profiling	15.175 s [15.175 s, 15.175 s]	100.0 ms (0.7%)
tracing	15.281 s [15.281 s, 15.281 s]	206.0 ms (1.4%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~4e03bf9bad, baseline=1.46.0-SNAPSHOT~f1d359b93f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.464 ms) : 1453, 1476
.   : milestone, 1464,
appsec (2.352 ms) : 2309, 2395
.   : milestone, 2352,
iast (2.093 ms) : 2039, 2147
.   : milestone, 2093,
iast_GLOBAL (2.136 ms) : 2082, 2191
.   : milestone, 2136,
profiling (1.964 ms) : 1920, 2008
.   : milestone, 1964,
tracing (1.923 ms) : 1882, 1964
.   : milestone, 1923,
section candidate
no_agent (1.464 ms) : 1453, 1475
.   : milestone, 1464,
appsec (2.345 ms) : 2303, 2388
.   : milestone, 2345,
iast (2.095 ms) : 2041, 2150
.   : milestone, 2095,
iast_GLOBAL (2.138 ms) : 2083, 2192
.   : milestone, 2138,
profiling (1.945 ms) : 1902, 1988
.   : milestone, 1945,
tracing (1.924 ms) : 1883, 1965
.   : milestone, 1924,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.464 ms [1.453 ms, 1.476 ms]	-
appsec	2.352 ms [2.309 ms, 2.395 ms]	887.759 µs (60.6%)
iast	2.093 ms [2.039 ms, 2.147 ms]	628.704 µs (42.9%)
iast_GLOBAL	2.136 ms [2.082 ms, 2.191 ms]	672.045 µs (45.9%)
profiling	1.964 ms [1.92 ms, 2.008 ms]	499.936 µs (34.1%)
tracing	1.923 ms [1.882 ms, 1.964 ms]	458.988 µs (31.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.464 ms [1.453 ms, 1.475 ms]	-
appsec	2.345 ms [2.303 ms, 2.388 ms]	881.079 µs (60.2%)
iast	2.095 ms [2.041 ms, 2.15 ms]	631.365 µs (43.1%)
iast_GLOBAL	2.138 ms [2.083 ms, 2.192 ms]	673.9 µs (46.0%)
profiling	1.945 ms [1.902 ms, 1.988 ms]	481.192 µs (32.9%)
tracing	1.924 ms [1.883 ms, 1.965 ms]	460.011 µs (31.4%)

Decouple test JDK and gradle JDK in karate latestDepTest

4e03bf9

smola added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jan 16, 2025

datadog-datadog-prod-us1 bot reviewed Jan 16, 2025

View reviewed changes

dd-java-agent/instrumentation/karate/build.gradle Show resolved Hide resolved

smola mentioned this pull request Jan 16, 2025

Decouple test JDK and gradle JDK in testng latestDepTest #8235

Merged

smola mentioned this pull request Jan 16, 2025

Decouple test JDK and gradle JDK in selenium latestDepTest #8236

Merged

smola marked this pull request as ready for review January 17, 2025 07:21

smola requested a review from a team as a code owner January 17, 2025 07:21

smola requested a review from juan-fernandez January 17, 2025 07:21

PerfectSlayer approved these changes Jan 17, 2025

View reviewed changes

smola merged commit f05dac8 into master Jan 17, 2025
170 of 174 checks passed

smola deleted the smola/karate-latest-jdk branch January 17, 2025 11:06

github-actions bot added this to the 1.46.0 milestone Jan 17, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Decouple test JDK and gradle JDK in karate latestDepTest #8234

Decouple test JDK and gradle JDK in karate latestDepTest #8234

smola commented Jan 16, 2025

pr-commenter bot commented Jan 16, 2025

Decouple test JDK and gradle JDK in karate latestDepTest #8234

Decouple test JDK and gradle JDK in karate latestDepTest #8234

Conversation

smola commented Jan 16, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Jan 16, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary