[GEODE-9943] ReplicatedIndexedQueryBenchmark perfomance degradation

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Assignee: Bala Tripura Sundari Kaza Venkata
• Reporter: Bala Tripura Sundari Kaza Venkata
• Created: 11/Jan/22 20:40
• Updated: 24/Feb/22 19:20
• Resolved: 11/Jan/22 22:40

Description

There is performance degradation on the ReplicatedIndexedQuery benchmark.
Below is the output:

org.apache.geode.benchmark.tests.ReplicatedIndexedQueryBenchmark
              average ops/second  Baseline:     31678.93  Test:     28420.90  Difference:  -10.3%
       ops/second standard error  Baseline:        48.69  Test:        50.69  Difference:   +4.1%
   ops/second standard deviation  Baseline:       840.57  Test:       874.99  Difference:   +4.1%
      YS 99th percentile latency  Baseline:     20095.61  Test:     20094.75  Difference:   -0.0%
                  median latency  Baseline:   7467007.00  Test:   7217151.00  Difference:   -3.3%
         90th percentile latency  Baseline:  54657023.00  Test:  81788927.00  Difference:  +49.6%
         99th percentile latency  Baseline: 111345663.00  Test: 134217727.00  Difference:  +20.5%
       99.9th percentile latency  Baseline: 226623487.00  Test: 202899455.00  Difference:  -10.5%
                 average latency  Baseline:  18182876.80  Test:  20330177.60  Difference:  +11.8%
      latency standard deviation  Baseline:  28044862.49  Test:  33920338.87  Difference:  +21.0%
          latency standard error  Baseline:      9109.64  Test:     11652.11  Difference:  +27.9%
              average ops/second  Baseline:     31594.76  Test:     28257.85  Difference:  -10.6%

Failure seen in this CI run: https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/benchmark-base/builds/83