Skip to content

Fix flaky exception debugger test#7084

Merged
jpbempel merged 1 commit intomasterfrom
jpbempel/fix-flaky-test
May 29, 2024
Merged

Fix flaky exception debugger test#7084
jpbempel merged 1 commit intomasterfrom
jpbempel/fix-flaky-test

Conversation

@jpbempel
Copy link
Copy Markdown
Member

@jpbempel jpbempel commented May 29, 2024 •
edited
Loading

What Does This Do

ensure the probes are installed before generating the snapshots

Motivation

Additional Notes

@jpbempel
Fix flaky exception debugger test
55cc57d 
ensure the probes are installed before generating the snapshots
@jpbempel jpbempel added tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation labels May 29, 2024
@jpbempel jpbempel requested a review from a team as a code owner May 29, 2024 09:53
@jpbempel jpbempel requested review from cimi and removed request for a team May 29, 2024 09:53
@jpbempel jpbempel merged commit 86231f4 into master May 29, 2024
@jpbempel jpbempel deleted the jpbempel/fix-flaky-test branch May 29, 2024 10:31
@github-actions github-actions bot added this to the 1.35.0 milestone May 29, 2024
@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 13, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-flaky-test
git_commit_date 1775834061 1776092304
git_commit_sha 5ab378f 64d63fb
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~64d63fb948
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776094144 1776094144
ci_job_id 1590024854 1590024854
ci_pipeline_id 107390343 107390343
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gycmdo32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gycmdo32 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057289
Total [baseline] (11.063 s) : 0, 11062511
Agent [candidate] (1.053 s) : 0, 1053241
Total [candidate] (11.03 s) : 0, 11030232
section appsec
Agent [baseline] (1.258 s) : 0, 1257544
Total [baseline] (11.14 s) : 0, 11139500
Agent [candidate] (1.241 s) : 0, 1240931
Total [candidate] (11.103 s) : 0, 11102769
section iast
Agent [baseline] (1.221 s) : 0, 1221029
Total [baseline] (11.317 s) : 0, 11317176
Agent [candidate] (1.218 s) : 0, 1217740
Total [candidate] (11.171 s) : 0, 11170998
section profiling
Agent [baseline] (1.182 s) : 0, 1182328
Total [baseline] (11.044 s) : 0, 11044388
Agent [candidate] (1.189 s) : 0, 1189045
Total [candidate] (11.151 s) : 0, 11150626
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.258 s 200.255 ms (18.9%)
Agent iast 1.221 s 163.74 ms (15.5%)
Agent profiling 1.182 s 125.039 ms (11.8%)
Total tracing 11.063 s -
Total appsec 11.14 s 76.989 ms (0.7%)
Total iast 11.317 s 254.665 ms (2.3%)
Total profiling 11.044 s -18.123 ms (-0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent appsec 1.241 s 187.69 ms (17.8%)
Agent iast 1.218 s 164.499 ms (15.6%)
Agent profiling 1.189 s 135.804 ms (12.9%)
Total tracing 11.03 s -
Total appsec 11.103 s 72.537 ms (0.7%)
Total iast 11.171 s 140.766 ms (1.3%)
Total profiling 11.151 s 120.393 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.217 ms) : 0, 1217
BytebuddyAgent [baseline] (632.523 ms) : 0, 632523
BytebuddyAgent [candidate] (631.411 ms) : 0, 631411
AgentMeter [baseline] (29.431 ms) : 0, 29431
AgentMeter [candidate] (29.411 ms) : 0, 29411
GlobalTracer [baseline] (248.869 ms) : 0, 248869
GlobalTracer [candidate] (247.968 ms) : 0, 247968
AppSec [baseline] (32.041 ms) : 0, 32041
AppSec [candidate] (31.935 ms) : 0, 31935
Debugger [baseline] (60.022 ms) : 0, 60022
Debugger [candidate] (59.935 ms) : 0, 59935
Remote Config [baseline] (600.554 µs) : 0, 601
Remote Config [candidate] (599.652 µs) : 0, 600
Telemetry [baseline] (8.127 ms) : 0, 8127
Telemetry [candidate] (8.053 ms) : 0, 8053
Flare Poller [baseline] (8.3 ms) : 0, 8300
Flare Poller [candidate] (6.585 ms) : 0, 6585
section appsec
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (665.957 ms) : 0, 665957
BytebuddyAgent [candidate] (658.003 ms) : 0, 658003
AgentMeter [baseline] (12.114 ms) : 0, 12114
AgentMeter [candidate] (11.989 ms) : 0, 11989
GlobalTracer [baseline] (251.613 ms) : 0, 251613
GlobalTracer [candidate] (247.475 ms) : 0, 247475
AppSec [baseline] (185.901 ms) : 0, 185901
AppSec [candidate] (183.794 ms) : 0, 183794
Debugger [baseline] (66.397 ms) : 0, 66397
Debugger [candidate] (65.112 ms) : 0, 65112
Remote Config [baseline] (611.21 µs) : 0, 611
Remote Config [candidate] (598.799 µs) : 0, 599
Telemetry [baseline] (8.722 ms) : 0, 8722
Telemetry [candidate] (8.486 ms) : 0, 8486
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.502 ms) : 0, 3502
IAST [baseline] (24.856 ms) : 0, 24856
IAST [candidate] (24.476 ms) : 0, 24476
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.212 ms) : 0, 1212
BytebuddyAgent [baseline] (798.401 ms) : 0, 798401
BytebuddyAgent [candidate] (796.68 ms) : 0, 796680
AgentMeter [baseline] (11.382 ms) : 0, 11382
AgentMeter [candidate] (11.335 ms) : 0, 11335
GlobalTracer [baseline] (238.387 ms) : 0, 238387
GlobalTracer [candidate] (237.916 ms) : 0, 237916
AppSec [baseline] (30.266 ms) : 0, 30266
AppSec [candidate] (34.032 ms) : 0, 34032
Debugger [baseline] (61.799 ms) : 0, 61799
Debugger [candidate] (57.356 ms) : 0, 57356
Remote Config [baseline] (525.867 µs) : 0, 526
Remote Config [candidate] (528.488 µs) : 0, 528
Telemetry [baseline] (12.991 ms) : 0, 12991
Telemetry [candidate] (13.368 ms) : 0, 13368
Flare Poller [baseline] (3.477 ms) : 0, 3477
Flare Poller [candidate] (3.448 ms) : 0, 3448
IAST [baseline] (26.431 ms) : 0, 26431
IAST [candidate] (25.724 ms) : 0, 25724
section profiling
ProfilingAgent [baseline] (93.327 ms) : 0, 93327
ProfilingAgent [candidate] (94.079 ms) : 0, 94079
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (689.857 ms) : 0, 689857
BytebuddyAgent [candidate] (694.761 ms) : 0, 694761
AgentMeter [baseline] (9.229 ms) : 0, 9229
AgentMeter [candidate] (9.172 ms) : 0, 9172
GlobalTracer [baseline] (207.304 ms) : 0, 207304
GlobalTracer [candidate] (208.1 ms) : 0, 208100
AppSec [baseline] (32.427 ms) : 0, 32427
AppSec [candidate] (32.626 ms) : 0, 32626
Debugger [baseline] (65.786 ms) : 0, 65786
Debugger [candidate] (65.5 ms) : 0, 65500
Remote Config [baseline] (582.14 µs) : 0, 582
Remote Config [candidate] (581.559 µs) : 0, 582
Telemetry [baseline] (7.813 ms) : 0, 7813
Telemetry [candidate] (7.844 ms) : 0, 7844
Flare Poller [baseline] (3.556 ms) : 0, 3556
Flare Poller [candidate] (3.581 ms) : 0, 3581
Profiling [baseline] (93.891 ms) : 0, 93891
Profiling [candidate] (94.651 ms) : 0, 94651
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055172
Total [baseline] (8.829 s) : 0, 8828531
Agent [candidate] (1.057 s) : 0, 1057110
Total [candidate] (8.847 s) : 0, 8847066
section iast
Agent [baseline] (1.218 s) : 0, 1218028
Total [baseline] (9.535 s) : 0, 9534601
Agent [candidate] (1.218 s) : 0, 1218443
Total [candidate] (9.553 s) : 0, 9552718
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.218 s 162.855 ms (15.4%)
Total tracing 8.829 s -
Total iast 9.535 s 706.07 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent iast 1.218 s 161.332 ms (15.3%)
Total tracing 8.847 s -
Total iast 9.553 s 705.652 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.246 ms) : 0, 1246
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (630.895 ms) : 0, 630895
BytebuddyAgent [candidate] (630.98 ms) : 0, 630980
AgentMeter [baseline] (29.349 ms) : 0, 29349
AgentMeter [candidate] (29.3 ms) : 0, 29300
GlobalTracer [baseline] (248.101 ms) : 0, 248101
GlobalTracer [candidate] (248.309 ms) : 0, 248309
AppSec [baseline] (32.003 ms) : 0, 32003
AppSec [candidate] (32.022 ms) : 0, 32022
Debugger [baseline] (59.077 ms) : 0, 59077
Debugger [candidate] (59.269 ms) : 0, 59269
Remote Config [baseline] (594.372 µs) : 0, 594
Remote Config [candidate] (596.869 µs) : 0, 597
Telemetry [baseline] (8.024 ms) : 0, 8024
Telemetry [candidate] (8.072 ms) : 0, 8072
Flare Poller [baseline] (9.81 ms) : 0, 9810
Flare Poller [candidate] (11.221 ms) : 0, 11221
section iast
crashtracking [baseline] (1.248 ms) : 0, 1248
crashtracking [candidate] (1.228 ms) : 0, 1228
BytebuddyAgent [baseline] (796.937 ms) : 0, 796937
BytebuddyAgent [candidate] (797.126 ms) : 0, 797126
AgentMeter [baseline] (11.297 ms) : 0, 11297
AgentMeter [candidate] (11.305 ms) : 0, 11305
GlobalTracer [baseline] (237.851 ms) : 0, 237851
GlobalTracer [candidate] (237.987 ms) : 0, 237987
AppSec [baseline] (31.056 ms) : 0, 31056
AppSec [candidate] (31.86 ms) : 0, 31860
Debugger [baseline] (59.663 ms) : 0, 59663
Debugger [candidate] (58.108 ms) : 0, 58108
Remote Config [baseline] (1.141 ms) : 0, 1141
Remote Config [candidate] (545.483 µs) : 0, 545
Telemetry [baseline] (13.346 ms) : 0, 13346
Telemetry [candidate] (14.104 ms) : 0, 14104
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.509 ms) : 0, 3509
IAST [baseline] (25.648 ms) : 0, 25648
IAST [candidate] (26.475 ms) : 0, 26475
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-flaky-test
git_commit_date 1775834061 1776092304
git_commit_sha 5ab378f 64d63fb
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~64d63fb948
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776094625 1776094625
ci_job_id 1590024855 1590024855
ci_pipeline_id 107390343 107390343
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-58jkkw2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-58jkkw2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load unsure
[-521.975µs; -84.614µs] or [-9.284%; -1.505%]		 better
[-1047.764µs; -273.149µs] or [-7.790%; -2.031%]		 unstable
[-54.854op/s; +107.354op/s] or [-7.450%; +14.580%]		 5.319ms 12.789ms 762.562op/s 5.622ms 13.450ms 736.312op/s
scenario:load:petclinic:appsec:high_load worse
[+0.673ms; +1.801ms] or [+3.686%; +9.857%]		 same
[-256.388µs; +1353.952µs] or [-0.847%; +4.472%]		 unstable
[-33.465op/s; +11.715op/s] or [-13.448%; +4.708%]		 19.510ms 30.823ms 237.969op/s 18.272ms 30.274ms 248.844op/s
scenario:load:petclinic:iast:high_load better
[-1286.308µs; -436.667µs] or [-6.947%; -2.358%]		 same
[-1435.428µs; +122.889µs] or [-4.849%; +0.415%]		 unstable
[-10.404op/s; +35.341op/s] or [-4.204%; +14.281%]		 17.655ms 28.949ms 259.938op/s 18.516ms 29.605ms 247.469op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.234 ms) : 1221, 1246
.   : milestone, 1234,
iast (3.345 ms) : 3297, 3392
.   : milestone, 3345,
iast_FULL (6.284 ms) : 6217, 6350
.   : milestone, 6284,
iast_GLOBAL (3.713 ms) : 3652, 3773
.   : milestone, 3713,
profiling (2.213 ms) : 2192, 2234
.   : milestone, 2213,
tracing (1.88 ms) : 1863, 1898
.   : milestone, 1880,
section candidate
no_agent (1.263 ms) : 1250, 1275
.   : milestone, 1263,
iast (3.362 ms) : 3316, 3408
.   : milestone, 3362,
iast_FULL (6.066 ms) : 6005, 6127
.   : milestone, 6066,
iast_GLOBAL (3.611 ms) : 3554, 3669
.   : milestone, 3611,
profiling (2.148 ms) : 2127, 2169
.   : milestone, 2148,
tracing (1.876 ms) : 1861, 1892
.   : milestone, 1876,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.234 ms [1.221 ms, 1.246 ms] -
iast 3.345 ms [3.297 ms, 3.392 ms] 2.111 ms (171.1%)
iast_FULL 6.284 ms [6.217 ms, 6.35 ms] 5.05 ms (409.4%)
iast_GLOBAL 3.713 ms [3.652 ms, 3.773 ms] 2.479 ms (201.0%)
profiling 2.213 ms [2.192 ms, 2.234 ms] 979.687 µs (79.4%)
tracing 1.88 ms [1.863 ms, 1.898 ms] 646.693 µs (52.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.263 ms [1.25 ms, 1.275 ms] -
iast 3.362 ms [3.316 ms, 3.408 ms] 2.099 ms (166.3%)
iast_FULL 6.066 ms [6.005 ms, 6.127 ms] 4.803 ms (380.4%)
iast_GLOBAL 3.611 ms [3.554 ms, 3.669 ms] 2.349 ms (186.0%)
profiling 2.148 ms [2.127 ms, 2.169 ms] 885.7 µs (70.2%)
tracing 1.876 ms [1.861 ms, 1.892 ms] 613.7 µs (48.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.17 ms) : 17984, 18355
.   : milestone, 18170,
appsec (18.759 ms) : 18566, 18952
.   : milestone, 18759,
code_origins (17.559 ms) : 17384, 17734
.   : milestone, 17559,
iast (18.855 ms) : 18670, 19041
.   : milestone, 18855,
profiling (18.407 ms) : 18220, 18593
.   : milestone, 18407,
tracing (17.688 ms) : 17517, 17858
.   : milestone, 17688,
section candidate
no_agent (19.14 ms) : 18947, 19333
.   : milestone, 19140,
appsec (19.615 ms) : 19417, 19813
.   : milestone, 19615,
code_origins (17.658 ms) : 17484, 17832
.   : milestone, 17658,
iast (17.952 ms) : 17772, 18133
.   : milestone, 17952,
profiling (18.228 ms) : 18048, 18408
.   : milestone, 18228,
tracing (17.837 ms) : 17658, 18016
.   : milestone, 17837,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.17 ms [17.984 ms, 18.355 ms] -
appsec 18.759 ms [18.566 ms, 18.952 ms] 589.51 µs (3.2%)
code_origins 17.559 ms [17.384 ms, 17.734 ms] -610.922 µs (-3.4%)
iast 18.855 ms [18.67 ms, 19.041 ms] 685.575 µs (3.8%)
profiling 18.407 ms [18.22 ms, 18.593 ms] 236.942 µs (1.3%)
tracing 17.688 ms [17.517 ms, 17.858 ms] -482.025 µs (-2.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.14 ms [18.947 ms, 19.333 ms] -
appsec 19.615 ms [19.417 ms, 19.813 ms] 474.923 µs (2.5%)
code_origins 17.658 ms [17.484 ms, 17.832 ms] -1.482 ms (-7.7%)
iast 17.952 ms [17.772 ms, 18.133 ms] -1.188 ms (-6.2%)
profiling 18.228 ms [18.048 ms, 18.408 ms] -911.87 µs (-4.8%)
tracing 17.837 ms [17.658 ms, 18.016 ms] -1.303 ms (-6.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/fix-flaky-test
git_commit_date 1775834061 1776092304
git_commit_sha 5ab378f 64d63fb
release_version 1.62.0-SNAPSHOT~5ab378f780 1.62.0-SNAPSHOT~64d63fb948
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776094235 1776094235
ci_job_id 1590024856 1590024856
ci_pipeline_id 107390343 107390343
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-kunxdf4x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-kunxdf4x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.472ms; -1.120ms] or [-38.278%; -29.123%]		 2.549ms 3.845ms
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.497 ms) : 1485, 1508
.   : milestone, 1497,
appsec (3.845 ms) : 3620, 4069
.   : milestone, 3845,
iast (2.296 ms) : 2226, 2366
.   : milestone, 2296,
iast_GLOBAL (2.341 ms) : 2271, 2411
.   : milestone, 2341,
profiling (2.117 ms) : 2062, 2172
.   : milestone, 2117,
tracing (2.117 ms) : 2063, 2171
.   : milestone, 2117,
section candidate
no_agent (1.504 ms) : 1492, 1516
.   : milestone, 1504,
appsec (2.549 ms) : 2494, 2604
.   : milestone, 2549,
iast (2.295 ms) : 2225, 2364
.   : milestone, 2295,
iast_GLOBAL (2.342 ms) : 2272, 2412
.   : milestone, 2342,
profiling (2.139 ms) : 2083, 2196
.   : milestone, 2139,
tracing (2.101 ms) : 2047, 2155
.   : milestone, 2101,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.497 ms [1.485 ms, 1.508 ms] -
appsec 3.845 ms [3.62 ms, 4.069 ms] 2.348 ms (156.9%)
iast 2.296 ms [2.226 ms, 2.366 ms] 799.303 µs (53.4%)
iast_GLOBAL 2.341 ms [2.271 ms, 2.411 ms] 844.096 µs (56.4%)
profiling 2.117 ms [2.062 ms, 2.172 ms] 620.412 µs (41.5%)
tracing 2.117 ms [2.063 ms, 2.171 ms] 620.331 µs (41.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.504 ms [1.492 ms, 1.516 ms] -
appsec 2.549 ms [2.494 ms, 2.604 ms] 1.045 ms (69.5%)
iast 2.295 ms [2.225 ms, 2.364 ms] 790.674 µs (52.6%)
iast_GLOBAL 2.342 ms [2.272 ms, 2.412 ms] 838.212 µs (55.7%)
profiling 2.139 ms [2.083 ms, 2.196 ms] 635.522 µs (42.3%)
tracing 2.101 ms [2.047 ms, 2.155 ms] 597.108 µs (39.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~64d63fb948, baseline=1.62.0-SNAPSHOT~5ab378f780
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.061 s) : 15061000, 15061000
.   : milestone, 15061000,
appsec (14.825 s) : 14825000, 14825000
.   : milestone, 14825000,
iast (18.126 s) : 18126000, 18126000
.   : milestone, 18126000,
iast_GLOBAL (18.261 s) : 18261000, 18261000
.   : milestone, 18261000,
profiling (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
tracing (14.731 s) : 14731000, 14731000
.   : milestone, 14731000,
section candidate
no_agent (15.537 s) : 15537000, 15537000
.   : milestone, 15537000,
appsec (14.751 s) : 14751000, 14751000
.   : milestone, 14751000,
iast (18.739 s) : 18739000, 18739000
.   : milestone, 18739000,
iast_GLOBAL (18.138 s) : 18138000, 18138000
.   : milestone, 18138000,
profiling (15.381 s) : 15381000, 15381000
.   : milestone, 15381000,
tracing (15.089 s) : 15089000, 15089000
.   : milestone, 15089000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.061 s [15.061 s, 15.061 s] -
appsec 14.825 s [14.825 s, 14.825 s] -236.0 ms (-1.6%)
iast 18.126 s [18.126 s, 18.126 s] 3.065 s (20.4%)
iast_GLOBAL 18.261 s [18.261 s, 18.261 s] 3.2 s (21.2%)
profiling 15.01 s [15.01 s, 15.01 s] -51.0 ms (-0.3%)
tracing 14.731 s [14.731 s, 14.731 s] -330.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.537 s [15.537 s, 15.537 s] -
appsec 14.751 s [14.751 s, 14.751 s] -786.0 ms (-5.1%)
iast 18.739 s [18.739 s, 18.739 s] 3.202 s (20.6%)
iast_GLOBAL 18.138 s [18.138 s, 18.138 s] 2.601 s (16.7%)
profiling 15.381 s [15.381 s, 15.381 s] -156.0 ms (-1.0%)
tracing 15.089 s [15.089 s, 15.089 s] -448.0 ms (-2.9%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@cimi cimi Awaiting requested review from cimi cimi is a code owner automatically assigned from DataDog/debugger-java

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

1.35.0

Development

Successfully merging this pull request may close these issues.

2 participants

@jpbempel @PerfectSlayer