[GEODE-8709] ReplicatedFunctionExecutionBenchmark failing

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.15.0
• Component/s: benchmarks
• Labels: benchmark
• Assignee: Unassigned
• Reporter: John Hutchison
• Created: 13/Nov/20 16:10
• Updated: 03/May/22 16:57

Description

 
org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionWithFiltersBenchmark 
average ops/second Baseline: 546625.03 Test: 537316.10 Difference: -1.7% 
ops/second standard error Baseline: 776.77 Test: 709.95 Difference: -8.6%
s/second standard deviation Baseline: 13431.54 Test: 12276.10 Difference: -8.6%
YS 99th percentile latency Baseline: 1700.00 Test: 1750.00 Difference: +2.9%
median latency Baseline: 1213439.00 Test: 1215487.00 Difference: +0.2%
90th percentile latency Baseline: 1465343.00 Test: 1518591.00 Difference: +3.6%
99th percentile latency Baseline: 4517887.00 Test: 4636671.00 Difference: +2.6%
99.9th percentile latency Baseline: 18202623.00 Test: 19234815.00 Difference: +5.7%
average latency Baseline: 1315053.32 Test: 1337898.07 Difference: +1.7%
latency standard deviation Baseline: 1303983.91 Test: 1335112.23 Difference: +2.4%
latency standard error Baseline: 101.85 Test: 105.17 Difference: +3.3%
average ops/second Baseline: 546531.56 Test: 537283.96 Difference: -1.7%

BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionBenchmark average latency is 5% worse than baseline.