Skip to content

feat: improvements to line level granularity in per-test coverage#11122

Draft
daniel-mohedano wants to merge 1 commit intomasterfrom
daniel.mohedano/line-coverage-improvements
Draft

feat: improvements to line level granularity in per-test coverage#11122
daniel-mohedano wants to merge 1 commit intomasterfrom
daniel.mohedano/line-coverage-improvements

Conversation

@daniel-mohedano
Copy link
Copy Markdown
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Apr 15, 2026
@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 55.85
agentEvpProxy 56.50

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 37.17
agentless 36.14
agentlessCodeCoverage 44.78
agentlessLineCoverage 75.31

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - netflix-zuul

Job Status: success

Scenario Overhead (%)
agent 87.37
agentless 81.94
agentlessCodeCoverage 97.05
agentlessLineCoverage 112.90

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 12.28
agentless 10.53
agentlessCodeCoverage 14.96

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 23.33
agentless 18.54
agentlessCodeCoverage 20.74
agentlessLineCoverage 30.74

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - jolokia

Job Status: success

Scenario Overhead (%)
agent 96.38
agentless 92.66
agentlessCodeCoverage 99.57
agentlessLineCoverage 101.05

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - sonar-kotlin

Job Status: failed

Scenario Overhead (%)
agent 12.62
agentless 11.45
agentlessCodeCoverage 15.81
agentlessLineCoverage 18.01

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 17.50
agentless 17.42
agentlessCodeCoverage 21.22
agentlessLineCoverage 42.03

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - sonar-java

Job Status: failed

Scenario Overhead (%)
agent -14.18
agentless -17.89
agentlessCodeCoverage 31.35
agentlessLineCoverage -69.71

@cit-pr-commenter-54b7da
Copy link
Copy Markdown

Test Environment - spring_boot

Job Status: failed

Scenario Overhead (%)
agent 16.57
agentless 9.58
agentlessCodeCoverage 13.76
agentlessLineCoverage 31.00

@pr-commenter
Copy link
Copy Markdown

pr-commenter bot commented Apr 15, 2026

Benchmarks

⚠️ Warning: Baseline build not found for merge-base commit. Comparing against the latest commit on master instead.

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776263577 1776263005
git_commit_sha 93449b6f0f 20e8485
release_version 1.62.0-SNAPSHOT~693449b6f0f 1.62.0-SNAPSHOT~20e8485faa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776264871 1776264871
ci_job_id 1597774168 1597774168
ci_pipeline_id 107830540 107830540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-z83h15ii 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-z83h15ii 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058514
Total [baseline] (11.123 s) : 0, 11122888
Agent [candidate] (1.057 s) : 0, 1056752
Total [candidate] (11.15 s) : 0, 11149758
section appsec
Agent [baseline] (1.254 s) : 0, 1253545
Total [baseline] (11.165 s) : 0, 11164837
Agent [candidate] (1.257 s) : 0, 1256523
Total [candidate] (11.108 s) : 0, 11108434
section iast
Agent [baseline] (1.224 s) : 0, 1224464
Total [baseline] (11.326 s) : 0, 11325792
Agent [candidate] (1.221 s) : 0, 1220980
Total [candidate] (11.217 s) : 0, 11217490
section profiling
Agent [baseline] (1.194 s) : 0, 1194226
Total [baseline] (11.085 s) : 0, 11085434
Agent [candidate] (1.185 s) : 0, 1185327
Total [candidate] (11.138 s) : 0, 11138331
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.254 s 195.031 ms (18.4%)
Agent iast 1.224 s 165.95 ms (15.7%)
Agent profiling 1.194 s 135.712 ms (12.8%)
Total tracing 11.123 s -
Total appsec 11.165 s 41.95 ms (0.4%)
Total iast 11.326 s 202.904 ms (1.8%)
Total profiling 11.085 s -37.454 ms (-0.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.257 s 199.772 ms (18.9%)
Agent iast 1.221 s 164.228 ms (15.5%)
Agent profiling 1.185 s 128.575 ms (12.2%)
Total tracing 11.15 s -
Total appsec 11.108 s -41.324 ms (-0.4%)
Total iast 11.217 s 67.731 ms (0.6%)
Total profiling 11.138 s -11.428 ms (-0.1%)
gantt
    title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (632.194 ms) : 0, 632194
BytebuddyAgent [candidate] (632.321 ms) : 0, 632321
AgentMeter [baseline] (29.456 ms) : 0, 29456
AgentMeter [candidate] (29.377 ms) : 0, 29377
GlobalTracer [baseline] (248.944 ms) : 0, 248944
GlobalTracer [candidate] (249.004 ms) : 0, 249004
AppSec [baseline] (32.384 ms) : 0, 32384
AppSec [candidate] (32.023 ms) : 0, 32023
Debugger [baseline] (60.195 ms) : 0, 60195
Debugger [candidate] (59.851 ms) : 0, 59851
Remote Config [baseline] (657.989 µs) : 0, 658
Remote Config [candidate] (594.372 µs) : 0, 594
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.046 ms) : 0, 8046
Flare Poller [baseline] (9.166 ms) : 0, 9166
Flare Poller [candidate] (8.3 ms) : 0, 8300
section appsec
crashtracking [baseline] (1.222 ms) : 0, 1222
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (664.063 ms) : 0, 664063
BytebuddyAgent [candidate] (666.573 ms) : 0, 666573
AgentMeter [baseline] (12.146 ms) : 0, 12146
AgentMeter [candidate] (12.191 ms) : 0, 12191
GlobalTracer [baseline] (249.767 ms) : 0, 249767
GlobalTracer [candidate] (250.367 ms) : 0, 250367
IAST [baseline] (24.84 ms) : 0, 24840
IAST [candidate] (24.773 ms) : 0, 24773
AppSec [baseline] (186.179 ms) : 0, 186179
AppSec [candidate] (185.891 ms) : 0, 185891
Debugger [baseline] (66.276 ms) : 0, 66276
Debugger [candidate] (66.223 ms) : 0, 66223
Remote Config [baseline] (615.489 µs) : 0, 615
Remote Config [candidate] (607.181 µs) : 0, 607
Telemetry [baseline] (8.391 ms) : 0, 8391
Telemetry [candidate] (8.582 ms) : 0, 8582
Flare Poller [baseline] (3.55 ms) : 0, 3550
Flare Poller [candidate] (3.571 ms) : 0, 3571
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (801.539 ms) : 0, 801539
BytebuddyAgent [candidate] (798.581 ms) : 0, 798581
AgentMeter [baseline] (11.381 ms) : 0, 11381
AgentMeter [candidate] (11.339 ms) : 0, 11339
GlobalTracer [baseline] (239.395 ms) : 0, 239395
GlobalTracer [candidate] (238.405 ms) : 0, 238405
IAST [baseline] (25.775 ms) : 0, 25775
IAST [candidate] (25.734 ms) : 0, 25734
AppSec [baseline] (31.916 ms) : 0, 31916
AppSec [candidate] (30.828 ms) : 0, 30828
Debugger [baseline] (61.236 ms) : 0, 61236
Debugger [candidate] (62.312 ms) : 0, 62312
Remote Config [baseline] (548.128 µs) : 0, 548
Remote Config [candidate] (527.345 µs) : 0, 527
Telemetry [baseline] (11.67 ms) : 0, 11670
Telemetry [candidate] (12.317 ms) : 0, 12317
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.445 ms) : 0, 3445
section profiling
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (696.941 ms) : 0, 696941
BytebuddyAgent [candidate] (691.25 ms) : 0, 691250
AgentMeter [baseline] (9.163 ms) : 0, 9163
AgentMeter [candidate] (9.2 ms) : 0, 9200
GlobalTracer [baseline] (208.793 ms) : 0, 208793
GlobalTracer [candidate] (207.374 ms) : 0, 207374
AppSec [baseline] (33.217 ms) : 0, 33217
AppSec [candidate] (32.565 ms) : 0, 32565
Debugger [baseline] (66.274 ms) : 0, 66274
Debugger [candidate] (65.958 ms) : 0, 65958
Remote Config [baseline] (594.697 µs) : 0, 595
Remote Config [candidate] (571.112 µs) : 0, 571
Telemetry [baseline] (7.9 ms) : 0, 7900
Telemetry [candidate] (7.88 ms) : 0, 7880
Flare Poller [baseline] (3.604 ms) : 0, 3604
Flare Poller [candidate] (3.596 ms) : 0, 3596
ProfilingAgent [baseline] (94.767 ms) : 0, 94767
ProfilingAgent [candidate] (94.519 ms) : 0, 94519
Profiling [baseline] (95.35 ms) : 0, 95350
Profiling [candidate] (95.091 ms) : 0, 95091
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058441
Total [baseline] (8.843 s) : 0, 8842733
Agent [candidate] (1.059 s) : 0, 1059333
Total [candidate] (8.894 s) : 0, 8893690
section iast
Agent [baseline] (1.224 s) : 0, 1224096
Total [baseline] (9.572 s) : 0, 9571600
Agent [candidate] (1.223 s) : 0, 1223493
Total [candidate] (9.557 s) : 0, 9556768
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.224 s 165.655 ms (15.7%)
Total tracing 8.843 s -
Total iast 9.572 s 728.867 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent iast 1.223 s 164.16 ms (15.5%)
Total tracing 8.894 s -
Total iast 9.557 s 663.078 ms (7.5%)
gantt
    title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.245 ms) : 0, 1245
BytebuddyAgent [baseline] (633.506 ms) : 0, 633506
BytebuddyAgent [candidate] (633.181 ms) : 0, 633181
AgentMeter [baseline] (29.441 ms) : 0, 29441
AgentMeter [candidate] (29.531 ms) : 0, 29531
GlobalTracer [baseline] (248.684 ms) : 0, 248684
GlobalTracer [candidate] (249.193 ms) : 0, 249193
AppSec [baseline] (32.343 ms) : 0, 32343
AppSec [candidate] (32.066 ms) : 0, 32066
Debugger [baseline] (59.21 ms) : 0, 59210
Debugger [candidate] (59.42 ms) : 0, 59420
Remote Config [baseline] (597.292 µs) : 0, 597
Remote Config [candidate] (589.309 µs) : 0, 589
Telemetry [baseline] (8.046 ms) : 0, 8046
Telemetry [candidate] (8.101 ms) : 0, 8101
Flare Poller [baseline] (9.143 ms) : 0, 9143
Flare Poller [candidate] (9.821 ms) : 0, 9821
section iast
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (801.992 ms) : 0, 801992
BytebuddyAgent [candidate] (802.731 ms) : 0, 802731
AgentMeter [baseline] (11.396 ms) : 0, 11396
AgentMeter [candidate] (11.429 ms) : 0, 11429
GlobalTracer [baseline] (238.978 ms) : 0, 238978
GlobalTracer [candidate] (238.769 ms) : 0, 238769
AppSec [baseline] (34.291 ms) : 0, 34291
AppSec [candidate] (33.123 ms) : 0, 33123
Debugger [baseline] (57.725 ms) : 0, 57725
Debugger [candidate] (59.295 ms) : 0, 59295
Remote Config [baseline] (537.513 µs) : 0, 538
Remote Config [candidate] (535.795 µs) : 0, 536
Telemetry [baseline] (12.378 ms) : 0, 12378
Telemetry [candidate] (11.012 ms) : 0, 11012
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.374 ms) : 0, 3374
IAST [baseline] (25.775 ms) : 0, 25775
IAST [candidate] (25.673 ms) : 0, 25673
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776263565 1776263005
git_commit_sha 93449b6f0f 20e8485
release_version 1.62.0-SNAPSHOT~693449b6f0f 1.62.0-SNAPSHOT~20e8485faa
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1776265333 1776265333
ci_job_id 1597774172 1597774172
ci_pipeline_id 107830540 107830540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-71tzw1qa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-71tzw1qa 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 1 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-209.875µs; -47.788µs] or [-11.240%; -2.559%]
unstable
[-1227.699µs; -140.139µs] or [-21.468%; -2.451%]
unstable
[-80.880op/s; +478.568op/s] or [-4.224%; +24.995%]
1.738ms 5.035ms 2113.500op/s 1.867ms 5.719ms 1914.656op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-404.887µs; -112.815µs] or [-7.544%; -2.102%]
better
[-1018.121µs; -329.233µs] or [-7.918%; -2.560%]
unstable
[-58.380op/s; +122.318op/s] or [-7.646%; +16.021%]
5.108ms 12.185ms 795.469op/s 5.367ms 12.859ms 763.500op/s
scenario:load:petclinic:iast:high_load better
[-1.414ms; -0.707ms] or [-7.707%; -3.851%]
better
[-2.173ms; -0.847ms] or [-7.316%; -2.850%]
unstable
[-13.848op/s; +41.098op/s] or [-5.541%; +16.445%]
17.290ms 28.199ms 263.531op/s 18.350ms 29.709ms 249.906op/s
scenario:load:petclinic:profiling:high_load worse
[+618.746µs; +1199.382µs] or [+3.510%; +6.805%]
same
[-101.476µs; +1117.519µs] or [-0.350%; +3.849%]
unstable
[-36.711op/s; +17.711op/s] or [-14.231%; +6.866%]
18.535ms 29.540ms 248.469op/s 17.626ms 29.032ms 257.969op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.245 ms) : 1233, 1258
.   : milestone, 1245,
iast (3.355 ms) : 3304, 3405
.   : milestone, 3355,
iast_FULL (6.055 ms) : 5994, 6117
.   : milestone, 6055,
iast_GLOBAL (3.931 ms) : 3863, 3999
.   : milestone, 3931,
profiling (2.368 ms) : 2345, 2392
.   : milestone, 2368,
tracing (1.908 ms) : 1892, 1924
.   : milestone, 1908,
section candidate
no_agent (1.259 ms) : 1247, 1271
.   : milestone, 1259,
iast (3.406 ms) : 3354, 3459
.   : milestone, 3406,
iast_FULL (5.811 ms) : 5754, 5869
.   : milestone, 5811,
iast_GLOBAL (3.798 ms) : 3733, 3864
.   : milestone, 3798,
profiling (2.139 ms) : 2119, 2158
.   : milestone, 2139,
tracing (1.852 ms) : 1837, 1867
.   : milestone, 1852,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.245 ms [1.233 ms, 1.258 ms] -
iast 3.355 ms [3.304 ms, 3.405 ms] 2.109 ms (169.4%)
iast_FULL 6.055 ms [5.994 ms, 6.117 ms] 4.81 ms (386.2%)
iast_GLOBAL 3.931 ms [3.863 ms, 3.999 ms] 2.686 ms (215.6%)
profiling 2.368 ms [2.345 ms, 2.392 ms] 1.123 ms (90.2%)
tracing 1.908 ms [1.892 ms, 1.924 ms] 662.309 µs (53.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.259 ms [1.247 ms, 1.271 ms] -
iast 3.406 ms [3.354 ms, 3.459 ms] 2.148 ms (170.7%)
iast_FULL 5.811 ms [5.754 ms, 5.869 ms] 4.553 ms (361.7%)
iast_GLOBAL 3.798 ms [3.733 ms, 3.864 ms] 2.54 ms (201.8%)
profiling 2.139 ms [2.119 ms, 2.158 ms] 879.987 µs (69.9%)
tracing 1.852 ms [1.837 ms, 1.867 ms] 593.304 µs (47.1%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.509 ms) : 19310, 19707
.   : milestone, 19509,
appsec (18.868 ms) : 18679, 19057
.   : milestone, 18868,
code_origins (17.902 ms) : 17723, 18081
.   : milestone, 17902,
iast (18.675 ms) : 18492, 18859
.   : milestone, 18675,
profiling (18.084 ms) : 17908, 18260
.   : milestone, 18084,
tracing (18.012 ms) : 17835, 18189
.   : milestone, 18012,
section candidate
no_agent (18.487 ms) : 18299, 18675
.   : milestone, 18487,
appsec (19.014 ms) : 18820, 19208
.   : milestone, 19014,
code_origins (17.985 ms) : 17805, 18164
.   : milestone, 17985,
iast (17.702 ms) : 17529, 17874
.   : milestone, 17702,
profiling (18.782 ms) : 18598, 18967
.   : milestone, 18782,
tracing (18.031 ms) : 17853, 18208
.   : milestone, 18031,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.509 ms [19.31 ms, 19.707 ms] -
appsec 18.868 ms [18.679 ms, 19.057 ms] -640.909 µs (-3.3%)
code_origins 17.902 ms [17.723 ms, 18.081 ms] -1.607 ms (-8.2%)
iast 18.675 ms [18.492 ms, 18.859 ms] -833.116 µs (-4.3%)
profiling 18.084 ms [17.908 ms, 18.26 ms] -1.424 ms (-7.3%)
tracing 18.012 ms [17.835 ms, 18.189 ms] -1.497 ms (-7.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.487 ms [18.299 ms, 18.675 ms] -
appsec 19.014 ms [18.82 ms, 19.208 ms] 526.911 µs (2.9%)
code_origins 17.985 ms [17.805 ms, 18.164 ms] -502.323 µs (-2.7%)
iast 17.702 ms [17.529 ms, 17.874 ms] -785.578 µs (-4.2%)
profiling 18.782 ms [18.598 ms, 18.967 ms] 295.099 µs (1.6%)
tracing 18.031 ms [17.853 ms, 18.208 ms] -456.514 µs (-2.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/line-coverage-improvements
git_commit_date 1776263829 1776263005
git_commit_sha 93449b6f0f 20e8485
release_version 1.62.0-SNAPSHOT~693449b6f0f 1.62.0-SNAPSHOT~20e8485faa
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1776265298 1776265298
ci_job_id 1597774176 1597774176
ci_pipeline_id 107830540 107830540
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-8vsbma2g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-8vsbma2g 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.506 s) : 15506000, 15506000
.   : milestone, 15506000,
appsec (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
iast (18.395 s) : 18395000, 18395000
.   : milestone, 18395000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
.   : milestone, 17956000,
profiling (14.762 s) : 14762000, 14762000
.   : milestone, 14762000,
tracing (15.11 s) : 15110000, 15110000
.   : milestone, 15110000,
section candidate
no_agent (15.571 s) : 15571000, 15571000
.   : milestone, 15571000,
appsec (14.637 s) : 14637000, 14637000
.   : milestone, 14637000,
iast (17.993 s) : 17993000, 17993000
.   : milestone, 17993000,
iast_GLOBAL (18.138 s) : 18138000, 18138000
.   : milestone, 18138000,
profiling (15.672 s) : 15672000, 15672000
.   : milestone, 15672000,
tracing (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.506 s [15.506 s, 15.506 s] -
appsec 14.87 s [14.87 s, 14.87 s] -636.0 ms (-4.1%)
iast 18.395 s [18.395 s, 18.395 s] 2.889 s (18.6%)
iast_GLOBAL 17.956 s [17.956 s, 17.956 s] 2.45 s (15.8%)
profiling 14.762 s [14.762 s, 14.762 s] -744.0 ms (-4.8%)
tracing 15.11 s [15.11 s, 15.11 s] -396.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.571 s [15.571 s, 15.571 s] -
appsec 14.637 s [14.637 s, 14.637 s] -934.0 ms (-6.0%)
iast 17.993 s [17.993 s, 17.993 s] 2.422 s (15.6%)
iast_GLOBAL 18.138 s [18.138 s, 18.138 s] 2.567 s (16.5%)
profiling 15.672 s [15.672 s, 15.672 s] 101.0 ms (0.6%)
tracing 14.911 s [14.911 s, 14.911 s] -660.0 ms (-4.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.494 ms) : 1482, 1505
.   : milestone, 1494,
appsec (3.864 ms) : 3640, 4087
.   : milestone, 3864,
iast (2.279 ms) : 2210, 2348
.   : milestone, 2279,
iast_GLOBAL (2.329 ms) : 2260, 2399
.   : milestone, 2329,
profiling (2.523 ms) : 2358, 2689
.   : milestone, 2523,
tracing (2.079 ms) : 2025, 2132
.   : milestone, 2079,
section candidate
no_agent (1.492 ms) : 1481, 1504
.   : milestone, 1492,
appsec (3.836 ms) : 3614, 4059
.   : milestone, 3836,
iast (2.28 ms) : 2211, 2349
.   : milestone, 2280,
iast_GLOBAL (2.321 ms) : 2251, 2390
.   : milestone, 2321,
profiling (2.106 ms) : 2051, 2161
.   : milestone, 2106,
tracing (2.088 ms) : 2034, 2142
.   : milestone, 2088,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.494 ms [1.482 ms, 1.505 ms] -
appsec 3.864 ms [3.64 ms, 4.087 ms] 2.37 ms (158.7%)
iast 2.279 ms [2.21 ms, 2.348 ms] 785.122 µs (52.6%)
iast_GLOBAL 2.329 ms [2.26 ms, 2.399 ms] 835.592 µs (55.9%)
profiling 2.523 ms [2.358 ms, 2.689 ms] 1.03 ms (68.9%)
tracing 2.079 ms [2.025 ms, 2.132 ms] 585.191 µs (39.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.492 ms [1.481 ms, 1.504 ms] -
appsec 3.836 ms [3.614 ms, 4.059 ms] 2.344 ms (157.1%)
iast 2.28 ms [2.211 ms, 2.349 ms] 787.513 µs (52.8%)
iast_GLOBAL 2.321 ms [2.251 ms, 2.39 ms] 828.095 µs (55.5%)
profiling 2.106 ms [2.051 ms, 2.161 ms] 613.137 µs (41.1%)
tracing 2.088 ms [2.034 ms, 2.142 ms] 596.053 µs (39.9%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant