-
Notifications
You must be signed in to change notification settings - Fork 293
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow enabling experimental JVMTI wallclock sampler #7641
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
jbachorik
added
tag: no release notes
Changes to exclude from release notes
comp: profiling
Profiling
labels
Sep 18, 2024
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.065 s) : 0, 1065138
Total [baseline] (8.537 s) : 0, 8536903
Agent [candidate] (1.061 s) : 0, 1060905
Total [candidate] (8.523 s) : 0, 8523070
section iast
Agent [baseline] (1.207 s) : 0, 1207060
Total [baseline] (9.062 s) : 0, 9062098
Agent [candidate] (1.188 s) : 0, 1188256
Total [candidate] (9.008 s) : 0, 9007873
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.197 s) : 0, 1197248
Total [baseline] (8.986 s) : 0, 8986367
Agent [candidate] (1.197 s) : 0, 1197338
Total [candidate] (9.026 s) : 0, 9025881
section iast_TELEMETRY_OFF
Agent [baseline] (1.186 s) : 0, 1185719
Total [baseline] (8.987 s) : 0, 8986698
Agent [candidate] (1.185 s) : 0, 1185211
Total [candidate] (8.985 s) : 0, 8985298
gantt
title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.75 ms) : 0, 680750
BytebuddyAgent [candidate] (677.827 ms) : 0, 677827
GlobalTracer [baseline] (310.302 ms) : 0, 310302
GlobalTracer [candidate] (309.15 ms) : 0, 309150
AppSec [baseline] (52.291 ms) : 0, 52291
AppSec [candidate] (52.206 ms) : 0, 52206
Remote Config [baseline] (669.561 µs) : 0, 670
Remote Config [candidate] (665.449 µs) : 0, 665
Telemetry [baseline] (7.469 ms) : 0, 7469
Telemetry [candidate] (7.482 ms) : 0, 7482
section iast
BytebuddyAgent [baseline] (804.73 ms) : 0, 804730
BytebuddyAgent [candidate] (791.315 ms) : 0, 791315
GlobalTracer [baseline] (302.602 ms) : 0, 302602
GlobalTracer [candidate] (298.202 ms) : 0, 298202
AppSec [baseline] (54.469 ms) : 0, 54469
AppSec [candidate] (55.085 ms) : 0, 55085
IAST [baseline] (23.481 ms) : 0, 23481
IAST [candidate] (21.972 ms) : 0, 21972
Remote Config [baseline] (620.075 µs) : 0, 620
Remote Config [candidate] (626.923 µs) : 0, 627
Telemetry [baseline] (7.37 ms) : 0, 7370
Telemetry [candidate] (7.404 ms) : 0, 7404
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (797.239 ms) : 0, 797239
BytebuddyAgent [candidate] (797.584 ms) : 0, 797584
GlobalTracer [baseline] (300.429 ms) : 0, 300429
GlobalTracer [candidate] (300.03 ms) : 0, 300030
AppSec [baseline] (53.485 ms) : 0, 53485
AppSec [candidate] (52.745 ms) : 0, 52745
IAST [baseline] (24.387 ms) : 0, 24387
IAST [candidate] (25.408 ms) : 0, 25408
Remote Config [baseline] (630.212 µs) : 0, 630
Remote Config [candidate] (587.342 µs) : 0, 587
Telemetry [baseline] (7.379 ms) : 0, 7379
Telemetry [candidate] (7.262 ms) : 0, 7262
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (788.601 ms) : 0, 788601
BytebuddyAgent [candidate] (787.994 ms) : 0, 787994
GlobalTracer [baseline] (298.722 ms) : 0, 298722
GlobalTracer [candidate] (298.485 ms) : 0, 298485
AppSec [baseline] (53.915 ms) : 0, 53915
AppSec [candidate] (55.022 ms) : 0, 55022
IAST [baseline] (22.267 ms) : 0, 22267
IAST [candidate] (21.415 ms) : 0, 21415
Remote Config [baseline] (603.006 µs) : 0, 603
Remote Config [candidate] (599.485 µs) : 0, 599
Telemetry [baseline] (8.01 ms) : 0, 8010
Telemetry [candidate] (8.076 ms) : 0, 8076
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067972
Total [baseline] (10.413 s) : 0, 10413062
Agent [candidate] (1.069 s) : 0, 1069009
Total [candidate] (10.358 s) : 0, 10357633
section appsec
Agent [baseline] (1.203 s) : 0, 1202763
Total [baseline] (10.69 s) : 0, 10690118
Agent [candidate] (1.2 s) : 0, 1200293
Total [candidate] (10.631 s) : 0, 10631126
section iast
Agent [baseline] (1.186 s) : 0, 1186495
Total [baseline] (10.81 s) : 0, 10810297
Agent [candidate] (1.189 s) : 0, 1188862
Total [candidate] (10.822 s) : 0, 10821966
section profiling
Agent [baseline] (1.262 s) : 0, 1261974
Total [baseline] (10.596 s) : 0, 10595711
Agent [candidate] (1.261 s) : 0, 1261031
Total [candidate] (10.54 s) : 0, 10539807
gantt
title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.216 ms) : 0, 682216
BytebuddyAgent [candidate] (682.989 ms) : 0, 682989
GlobalTracer [baseline] (311.088 ms) : 0, 311088
GlobalTracer [candidate] (311.129 ms) : 0, 311129
AppSec [baseline] (52.832 ms) : 0, 52832
AppSec [candidate] (52.945 ms) : 0, 52945
Remote Config [baseline] (670.714 µs) : 0, 671
Remote Config [candidate] (677.584 µs) : 0, 678
Telemetry [baseline] (7.52 ms) : 0, 7520
Telemetry [candidate] (7.59 ms) : 0, 7590
section appsec
BytebuddyAgent [baseline] (703.602 ms) : 0, 703602
BytebuddyAgent [candidate] (702.582 ms) : 0, 702582
GlobalTracer [baseline] (304.396 ms) : 0, 304396
GlobalTracer [candidate] (303.023 ms) : 0, 303023
AppSec [baseline] (161.099 ms) : 0, 161099
AppSec [candidate] (161.721 ms) : 0, 161721
IAST [baseline] (19.953 ms) : 0, 19953
IAST [candidate] (21.421 ms) : 0, 21421
Remote Config [baseline] (647.013 µs) : 0, 647
Remote Config [candidate] (637.936 µs) : 0, 638
Telemetry [baseline] (9.429 ms) : 0, 9429
Telemetry [candidate] (7.999 ms) : 0, 7999
section iast
BytebuddyAgent [baseline] (790.2 ms) : 0, 790200
BytebuddyAgent [candidate] (791.446 ms) : 0, 791446
GlobalTracer [baseline] (297.998 ms) : 0, 297998
GlobalTracer [candidate] (298.521 ms) : 0, 298521
AppSec [baseline] (52.4 ms) : 0, 52400
AppSec [candidate] (51.478 ms) : 0, 51478
IAST [baseline] (24.275 ms) : 0, 24275
IAST [candidate] (26.01 ms) : 0, 26010
Remote Config [baseline] (665.337 µs) : 0, 665
Remote Config [candidate] (597.246 µs) : 0, 597
Telemetry [baseline] (7.373 ms) : 0, 7373
Telemetry [candidate] (7.21 ms) : 0, 7210
section profiling
BytebuddyAgent [baseline] (671.008 ms) : 0, 671008
BytebuddyAgent [candidate] (672.167 ms) : 0, 672167
GlobalTracer [baseline] (394.656 ms) : 0, 394656
GlobalTracer [candidate] (393.819 ms) : 0, 393819
AppSec [baseline] (53.388 ms) : 0, 53388
AppSec [candidate] (53.044 ms) : 0, 53044
Remote Config [baseline] (660.069 µs) : 0, 660
Remote Config [candidate] (656.686 µs) : 0, 657
Telemetry [baseline] (7.439 ms) : 0, 7439
Telemetry [candidate] (7.429 ms) : 0, 7429
ProfilingAgent [baseline] (96.84 ms) : 0, 96840
ProfilingAgent [candidate] (95.976 ms) : 0, 95976
Profiling [baseline] (96.863 ms) : 0, 96863
Profiling [candidate] (95.999 ms) : 0, 95999
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics. Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section baseline
no_agent (1.335 ms) : 1315, 1356
. : milestone, 1335,
appsec (1.727 ms) : 1703, 1751
. : milestone, 1727,
appsec_no_iast (1.703 ms) : 1679, 1727
. : milestone, 1703,
iast (1.462 ms) : 1439, 1485
. : milestone, 1462,
profiling (1.482 ms) : 1459, 1505
. : milestone, 1482,
tracing (1.453 ms) : 1428, 1478
. : milestone, 1453,
section candidate
no_agent (1.34 ms) : 1321, 1359
. : milestone, 1340,
appsec (1.717 ms) : 1692, 1742
. : milestone, 1717,
appsec_no_iast (1.741 ms) : 1717, 1766
. : milestone, 1741,
iast (1.478 ms) : 1456, 1501
. : milestone, 1478,
profiling (1.475 ms) : 1452, 1498
. : milestone, 1475,
tracing (1.458 ms) : 1434, 1482
. : milestone, 1458,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section baseline
no_agent (369.776 µs) : 350, 389
. : milestone, 370,
iast (479.907 µs) : 459, 501
. : milestone, 480,
iast_FULL (548.898 µs) : 528, 570
. : milestone, 549,
iast_GLOBAL (497.6 µs) : 476, 519
. : milestone, 498,
iast_HARDCODED_SECRET_DISABLED (484.346 µs) : 463, 506
. : milestone, 484,
iast_INACTIVE (449.129 µs) : 428, 470
. : milestone, 449,
iast_TELEMETRY_OFF (475.488 µs) : 452, 499
. : milestone, 475,
tracing (437.166 µs) : 417, 458
. : milestone, 437,
section candidate
no_agent (374.66 µs) : 354, 395
. : milestone, 375,
iast (478.274 µs) : 457, 500
. : milestone, 478,
iast_FULL (545.561 µs) : 524, 567
. : milestone, 546,
iast_GLOBAL (509.92 µs) : 489, 531
. : milestone, 510,
iast_HARDCODED_SECRET_DISABLED (481.899 µs) : 461, 503
. : milestone, 482,
iast_INACTIVE (439.753 µs) : 419, 460
. : milestone, 440,
iast_TELEMETRY_OFF (477.938 µs) : 455, 501
. : milestone, 478,
tracing (441.25 µs) : 421, 462
. : milestone, 441,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
. : milestone, 1477,
appsec (2.313 ms) : 2272, 2354
. : milestone, 2313,
iast (2.073 ms) : 2023, 2124
. : milestone, 2073,
iast_GLOBAL (2.116 ms) : 2065, 2167
. : milestone, 2116,
profiling (1.942 ms) : 1901, 1982
. : milestone, 1942,
tracing (1.913 ms) : 1875, 1951
. : milestone, 1913,
section candidate
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (2.303 ms) : 2262, 2344
. : milestone, 2303,
iast (2.072 ms) : 2021, 2123
. : milestone, 2072,
iast_GLOBAL (2.104 ms) : 2053, 2154
. : milestone, 2104,
profiling (1.951 ms) : 1911, 1991
. : milestone, 1951,
tracing (1.921 ms) : 1882, 1960
. : milestone, 1921,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~f59c400c61, baseline=1.40.0-SNAPSHOT~3c0cbd7307
dateFormat X
axisFormat %s
section baseline
no_agent (15.02 s) : 15020000, 15020000
. : milestone, 15020000,
appsec (15.236 s) : 15236000, 15236000
. : milestone, 15236000,
iast (18.876 s) : 18876000, 18876000
. : milestone, 18876000,
iast_GLOBAL (17.952 s) : 17952000, 17952000
. : milestone, 17952000,
profiling (15.401 s) : 15401000, 15401000
. : milestone, 15401000,
tracing (15.069 s) : 15069000, 15069000
. : milestone, 15069000,
section candidate
no_agent (15.833 s) : 15833000, 15833000
. : milestone, 15833000,
appsec (15.059 s) : 15059000, 15059000
. : milestone, 15059000,
iast (18.713 s) : 18713000, 18713000
. : milestone, 18713000,
iast_GLOBAL (17.972 s) : 17972000, 17972000
. : milestone, 17972000,
profiling (15.126 s) : 15126000, 15126000
. : milestone, 15126000,
tracing (15.289 s) : 15289000, 15289000
. : milestone, 15289000,
|
richardstartin
approved these changes
Sep 18, 2024
jbachorik
changed the title
Allow enabling experimenta JVMTI wallclock sampler
Allow enabling experimental JVMTI wallclock sampler
Sep 19, 2024
jordan-wong
pushed a commit
that referenced
this pull request
Sep 23, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
This adds the config flag to enable the experimental JVMTI wallclock samplers
Motivation
Need to try this feature in dogfooding first and for that we need a way to enable it.
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: PROF-10079