[GEODE-7420] PartitionedIndexedQueryBenchmark failed

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: benchmarks
• Assignee: Unassigned
• Reporter: Eric Shu
• Created: 07/Nov/19 18:32
• Updated: 21/Oct/20 16:35

Description

Benchmarks failed in https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark/builds/670

SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark
              average ops/second  Baseline:     32309.71  Test:     30390.65  Difference:   -5.9%
       ops/second standard error  Baseline:        50.85  Test:        37.40  Difference:  -26.4%
   ops/second standard deviation  Baseline:       879.21  Test:       646.71  Difference:  -26.4%
      YS 99th percentile latency  Baseline:     20096.43  Test:     20096.09  Difference:   -0.0%
                  median latency  Baseline:   8962047.00  Test:   8634367.00  Difference:   -3.7%
         90th percentile latency  Baseline:  35323903.00  Test:  49414143.00  Difference:  +39.9%
         99th percentile latency  Baseline: 216399871.00  Test: 114360319.00  Difference:  -47.2%
       99.9th percentile latency  Baseline: 258473983.00  Test: 230948863.00  Difference:  -10.6%
                 average latency  Baseline:  17829254.97  Test:  18979417.96  Difference:   +6.5%
      latency standard deviation  Baseline:  29915296.71  Test:  26736072.76  Difference:  -10.6%
          latency standard error  Baseline:      9616.70  Test:      8868.23  Difference:   -7.8%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.PartitionedIndexedQueryBenchmark average latency is 5% worse than baseline.