feat: improvements to line level granularity in per-test coverage#11122
Draft
daniel-mohedano wants to merge 1 commit intomasterfrom
Draft
feat: improvements to line level granularity in per-test coverage#11122daniel-mohedano wants to merge 1 commit intomasterfrom
daniel-mohedano wants to merge 1 commit intomasterfrom
Conversation
Test Environment - sbt-scalatestJob Status: success
|
Test Environment - nebula-release-pluginJob Status: success
|
Test Environment - netflix-zuulJob Status: success
|
Test Environment - pass4sJob Status: success
|
Test Environment - reactive-streams-jvmJob Status: success
|
Test Environment - jolokiaJob Status: success
|
Test Environment - sonar-kotlinJob Status: failed
|
Test Environment - okhttpJob Status: success
|
Test Environment - sonar-javaJob Status: failed
|
Test Environment - spring_bootJob Status: failed
|
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058514
Total [baseline] (11.123 s) : 0, 11122888
Agent [candidate] (1.057 s) : 0, 1056752
Total [candidate] (11.15 s) : 0, 11149758
section appsec
Agent [baseline] (1.254 s) : 0, 1253545
Total [baseline] (11.165 s) : 0, 11164837
Agent [candidate] (1.257 s) : 0, 1256523
Total [candidate] (11.108 s) : 0, 11108434
section iast
Agent [baseline] (1.224 s) : 0, 1224464
Total [baseline] (11.326 s) : 0, 11325792
Agent [candidate] (1.221 s) : 0, 1220980
Total [candidate] (11.217 s) : 0, 11217490
section profiling
Agent [baseline] (1.194 s) : 0, 1194226
Total [baseline] (11.085 s) : 0, 11085434
Agent [candidate] (1.185 s) : 0, 1185327
Total [candidate] (11.138 s) : 0, 11138331
gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (632.194 ms) : 0, 632194
BytebuddyAgent [candidate] (632.321 ms) : 0, 632321
AgentMeter [baseline] (29.456 ms) : 0, 29456
AgentMeter [candidate] (29.377 ms) : 0, 29377
GlobalTracer [baseline] (248.944 ms) : 0, 248944
GlobalTracer [candidate] (249.004 ms) : 0, 249004
AppSec [baseline] (32.384 ms) : 0, 32384
AppSec [candidate] (32.023 ms) : 0, 32023
Debugger [baseline] (60.195 ms) : 0, 60195
Debugger [candidate] (59.851 ms) : 0, 59851
Remote Config [baseline] (657.989 µs) : 0, 658
Remote Config [candidate] (594.372 µs) : 0, 594
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.046 ms) : 0, 8046
Flare Poller [baseline] (9.166 ms) : 0, 9166
Flare Poller [candidate] (8.3 ms) : 0, 8300
section appsec
crashtracking [baseline] (1.222 ms) : 0, 1222
crashtracking [candidate] (1.23 ms) : 0, 1230
BytebuddyAgent [baseline] (664.063 ms) : 0, 664063
BytebuddyAgent [candidate] (666.573 ms) : 0, 666573
AgentMeter [baseline] (12.146 ms) : 0, 12146
AgentMeter [candidate] (12.191 ms) : 0, 12191
GlobalTracer [baseline] (249.767 ms) : 0, 249767
GlobalTracer [candidate] (250.367 ms) : 0, 250367
IAST [baseline] (24.84 ms) : 0, 24840
IAST [candidate] (24.773 ms) : 0, 24773
AppSec [baseline] (186.179 ms) : 0, 186179
AppSec [candidate] (185.891 ms) : 0, 185891
Debugger [baseline] (66.276 ms) : 0, 66276
Debugger [candidate] (66.223 ms) : 0, 66223
Remote Config [baseline] (615.489 µs) : 0, 615
Remote Config [candidate] (607.181 µs) : 0, 607
Telemetry [baseline] (8.391 ms) : 0, 8391
Telemetry [candidate] (8.582 ms) : 0, 8582
Flare Poller [baseline] (3.55 ms) : 0, 3550
Flare Poller [candidate] (3.571 ms) : 0, 3571
section iast
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.232 ms) : 0, 1232
BytebuddyAgent [baseline] (801.539 ms) : 0, 801539
BytebuddyAgent [candidate] (798.581 ms) : 0, 798581
AgentMeter [baseline] (11.381 ms) : 0, 11381
AgentMeter [candidate] (11.339 ms) : 0, 11339
GlobalTracer [baseline] (239.395 ms) : 0, 239395
GlobalTracer [candidate] (238.405 ms) : 0, 238405
IAST [baseline] (25.775 ms) : 0, 25775
IAST [candidate] (25.734 ms) : 0, 25734
AppSec [baseline] (31.916 ms) : 0, 31916
AppSec [candidate] (30.828 ms) : 0, 30828
Debugger [baseline] (61.236 ms) : 0, 61236
Debugger [candidate] (62.312 ms) : 0, 62312
Remote Config [baseline] (548.128 µs) : 0, 548
Remote Config [candidate] (527.345 µs) : 0, 527
Telemetry [baseline] (11.67 ms) : 0, 11670
Telemetry [candidate] (12.317 ms) : 0, 12317
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.445 ms) : 0, 3445
section profiling
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (696.941 ms) : 0, 696941
BytebuddyAgent [candidate] (691.25 ms) : 0, 691250
AgentMeter [baseline] (9.163 ms) : 0, 9163
AgentMeter [candidate] (9.2 ms) : 0, 9200
GlobalTracer [baseline] (208.793 ms) : 0, 208793
GlobalTracer [candidate] (207.374 ms) : 0, 207374
AppSec [baseline] (33.217 ms) : 0, 33217
AppSec [candidate] (32.565 ms) : 0, 32565
Debugger [baseline] (66.274 ms) : 0, 66274
Debugger [candidate] (65.958 ms) : 0, 65958
Remote Config [baseline] (594.697 µs) : 0, 595
Remote Config [candidate] (571.112 µs) : 0, 571
Telemetry [baseline] (7.9 ms) : 0, 7900
Telemetry [candidate] (7.88 ms) : 0, 7880
Flare Poller [baseline] (3.604 ms) : 0, 3604
Flare Poller [candidate] (3.596 ms) : 0, 3596
ProfilingAgent [baseline] (94.767 ms) : 0, 94767
ProfilingAgent [candidate] (94.519 ms) : 0, 94519
Profiling [baseline] (95.35 ms) : 0, 95350
Profiling [candidate] (95.091 ms) : 0, 95091
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058441
Total [baseline] (8.843 s) : 0, 8842733
Agent [candidate] (1.059 s) : 0, 1059333
Total [candidate] (8.894 s) : 0, 8893690
section iast
Agent [baseline] (1.224 s) : 0, 1224096
Total [baseline] (9.572 s) : 0, 9571600
Agent [candidate] (1.223 s) : 0, 1223493
Total [candidate] (9.557 s) : 0, 9556768
gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.245 ms) : 0, 1245
BytebuddyAgent [baseline] (633.506 ms) : 0, 633506
BytebuddyAgent [candidate] (633.181 ms) : 0, 633181
AgentMeter [baseline] (29.441 ms) : 0, 29441
AgentMeter [candidate] (29.531 ms) : 0, 29531
GlobalTracer [baseline] (248.684 ms) : 0, 248684
GlobalTracer [candidate] (249.193 ms) : 0, 249193
AppSec [baseline] (32.343 ms) : 0, 32343
AppSec [candidate] (32.066 ms) : 0, 32066
Debugger [baseline] (59.21 ms) : 0, 59210
Debugger [candidate] (59.42 ms) : 0, 59420
Remote Config [baseline] (597.292 µs) : 0, 597
Remote Config [candidate] (589.309 µs) : 0, 589
Telemetry [baseline] (8.046 ms) : 0, 8046
Telemetry [candidate] (8.101 ms) : 0, 8101
Flare Poller [baseline] (9.143 ms) : 0, 9143
Flare Poller [candidate] (9.821 ms) : 0, 9821
section iast
crashtracking [baseline] (1.24 ms) : 0, 1240
crashtracking [candidate] (1.223 ms) : 0, 1223
BytebuddyAgent [baseline] (801.992 ms) : 0, 801992
BytebuddyAgent [candidate] (802.731 ms) : 0, 802731
AgentMeter [baseline] (11.396 ms) : 0, 11396
AgentMeter [candidate] (11.429 ms) : 0, 11429
GlobalTracer [baseline] (238.978 ms) : 0, 238978
GlobalTracer [candidate] (238.769 ms) : 0, 238769
AppSec [baseline] (34.291 ms) : 0, 34291
AppSec [candidate] (33.123 ms) : 0, 33123
Debugger [baseline] (57.725 ms) : 0, 57725
Debugger [candidate] (59.295 ms) : 0, 59295
Remote Config [baseline] (537.513 µs) : 0, 538
Remote Config [candidate] (535.795 µs) : 0, 536
Telemetry [baseline] (12.378 ms) : 0, 12378
Telemetry [candidate] (11.012 ms) : 0, 11012
Flare Poller [baseline] (3.451 ms) : 0, 3451
Flare Poller [candidate] (3.374 ms) : 0, 3374
IAST [baseline] (25.775 ms) : 0, 25775
IAST [candidate] (25.673 ms) : 0, 25673
LoadParameters
See matching parameters
SummaryFound 5 performance improvements and 1 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section baseline
no_agent (1.245 ms) : 1233, 1258
. : milestone, 1245,
iast (3.355 ms) : 3304, 3405
. : milestone, 3355,
iast_FULL (6.055 ms) : 5994, 6117
. : milestone, 6055,
iast_GLOBAL (3.931 ms) : 3863, 3999
. : milestone, 3931,
profiling (2.368 ms) : 2345, 2392
. : milestone, 2368,
tracing (1.908 ms) : 1892, 1924
. : milestone, 1908,
section candidate
no_agent (1.259 ms) : 1247, 1271
. : milestone, 1259,
iast (3.406 ms) : 3354, 3459
. : milestone, 3406,
iast_FULL (5.811 ms) : 5754, 5869
. : milestone, 5811,
iast_GLOBAL (3.798 ms) : 3733, 3864
. : milestone, 3798,
profiling (2.139 ms) : 2119, 2158
. : milestone, 2139,
tracing (1.852 ms) : 1837, 1867
. : milestone, 1852,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section baseline
no_agent (19.509 ms) : 19310, 19707
. : milestone, 19509,
appsec (18.868 ms) : 18679, 19057
. : milestone, 18868,
code_origins (17.902 ms) : 17723, 18081
. : milestone, 17902,
iast (18.675 ms) : 18492, 18859
. : milestone, 18675,
profiling (18.084 ms) : 17908, 18260
. : milestone, 18084,
tracing (18.012 ms) : 17835, 18189
. : milestone, 18012,
section candidate
no_agent (18.487 ms) : 18299, 18675
. : milestone, 18487,
appsec (19.014 ms) : 18820, 19208
. : milestone, 19014,
code_origins (17.985 ms) : 17805, 18164
. : milestone, 17985,
iast (17.702 ms) : 17529, 17874
. : milestone, 17702,
profiling (18.782 ms) : 18598, 18967
. : milestone, 18782,
tracing (18.031 ms) : 17853, 18208
. : milestone, 18031,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section baseline
no_agent (15.506 s) : 15506000, 15506000
. : milestone, 15506000,
appsec (14.87 s) : 14870000, 14870000
. : milestone, 14870000,
iast (18.395 s) : 18395000, 18395000
. : milestone, 18395000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
. : milestone, 17956000,
profiling (14.762 s) : 14762000, 14762000
. : milestone, 14762000,
tracing (15.11 s) : 15110000, 15110000
. : milestone, 15110000,
section candidate
no_agent (15.571 s) : 15571000, 15571000
. : milestone, 15571000,
appsec (14.637 s) : 14637000, 14637000
. : milestone, 14637000,
iast (17.993 s) : 17993000, 17993000
. : milestone, 17993000,
iast_GLOBAL (18.138 s) : 18138000, 18138000
. : milestone, 18138000,
profiling (15.672 s) : 15672000, 15672000
. : milestone, 15672000,
tracing (14.911 s) : 14911000, 14911000
. : milestone, 14911000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~20e8485faa, baseline=1.62.0-SNAPSHOT~693449b6f0f
dateFormat X
axisFormat %s
section baseline
no_agent (1.494 ms) : 1482, 1505
. : milestone, 1494,
appsec (3.864 ms) : 3640, 4087
. : milestone, 3864,
iast (2.279 ms) : 2210, 2348
. : milestone, 2279,
iast_GLOBAL (2.329 ms) : 2260, 2399
. : milestone, 2329,
profiling (2.523 ms) : 2358, 2689
. : milestone, 2523,
tracing (2.079 ms) : 2025, 2132
. : milestone, 2079,
section candidate
no_agent (1.492 ms) : 1481, 1504
. : milestone, 1492,
appsec (3.836 ms) : 3614, 4059
. : milestone, 3836,
iast (2.28 ms) : 2211, 2349
. : milestone, 2280,
iast_GLOBAL (2.321 ms) : 2251, 2390
. : milestone, 2321,
profiling (2.106 ms) : 2051, 2161
. : milestone, 2106,
tracing (2.088 ms) : 2034, 2142
. : milestone, 2088,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any other useful labelsclose,fix, or any linking keywords when referencing an issueUse
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]
Note: Once your PR is ready to merge, add it to the merge queue by commenting
/merge./merge -ccancels the queue request./merge -f --reason "reason"skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.