Report Generated on 2022-06-23 Run Description: "7a26ff4b97603e60c91f5211e6e139affd213752 vs a585a73594a25825be1134a991a7bfba928da9bc" Cluster Name: UNKNOWN Lab Run Info: UNKNOWN Impala Version: impalad version 4.2.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 4.2.0-SNAPSHOT RELEASE (2022-06-22) +----------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +----------+-----------------------+---------+------------+------------+----------------+ | TPCH(42) | parquet / none / none | 4.15 | -3.81% | 2.91 | -3.89% | +----------+-----------------------+---------+------------+------------+----------------+ +----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+--------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval | +----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+--------+ | TPCH(42) | TPCH-Q6 | parquet / none / none | 0.76 | 0.77 | -1.16% | 1.10% | 2.64% | 50 | -0.05% | -2.24 | -2.87 | | TPCH(42) | TPCH-Q1 | parquet / none / none | 4.91 | 4.98 | -1.37% | 1.16% | 8.92% | 50 | -0.02% | -0.65 | -1.08 | | TPCH(42) | TPCH-Q13 | parquet / none / none | 6.86 | 6.92 | -0.96% | 0.59% | 0.42% | 50 | -0.75% | -7.05 | -9.47 | | TPCH(42) | TPCH-Q18 | parquet / none / none | 9.93 | 10.08 | -1.50% | 0.98% | 0.86% | 50 | -1.53% | -6.59 | -8.19 | | TPCH(42) | TPCH-Q22 | parquet / none / none | 1.94 | 1.97 | -1.36% | 2.04% | 1.91% | 50 | -2.05% | -2.56 | -3.46 | | TPCH(42) | TPCH-Q3 | parquet / none / none | 3.89 | 3.98 | -2.18% | 1.10% | 1.08% | 50 | -2.57% | -7.22 | -10.12 | | TPCH(42) | TPCH-Q15 | parquet / none / none | 2.53 | 2.60 | -2.87% | 1.54% | 3.29% | 50 | -2.16% | -6.66 | -5.63 | | TPCH(42) | TPCH-Q16 | parquet / none / none | 1.87 | 1.93 | -3.03% | 1.42% | 1.54% | 50 | -2.75% | -8.06 | -10.38 | | TPCH(42) | TPCH-Q12 | parquet / none / none | 1.77 | 1.84 | -3.42% | 2.63% | 4.18% | 50 | -2.82% | -4.87 | -4.94 | | TPCH(42) | TPCH-Q9 | parquet / none / none | 10.86 | 11.26 | -3.54% | 0.90% | 0.89% | 50 | -3.64% | -8.53 | -20.14 | | TPCH(42) | TPCH-Q14 | parquet / none / none | 1.91 | 2.00 | -4.57% | 1.89% | * 10.95% * | 50 | -2.72% | -6.11 | -2.91 | | TPCH(42) | TPCH-Q21 | parquet / none / none | 20.73 | 21.94 | I -5.47% | 0.66% | 7.36% | 50 | I -2.21% | -8.15 | -5.24 | | TPCH(42) | TPCH-Q4 | parquet / none / none | 2.17 | 2.26 | -4.06% | 1.45% | 1.59% | 50 | -4.60% | -8.17 | -13.59 | | TPCH(42) | TPCH-Q8 | parquet / none / none | 3.23 | 3.37 | -4.20% | 1.23% | 1.03% | 50 | -4.60% | -8.47 | -19.04 | | TPCH(42) | TPCH-Q7 | parquet / none / none | 3.19 | 3.35 | -4.73% | 2.02% | 2.40% | 50 | -4.74% | -7.37 | -10.88 | | TPCH(42) | TPCH-Q10 | parquet / none / none | 3.46 | 3.62 | -4.24% | 4.25% | 1.73% | 50 | -5.50% | -7.71 | -6.79 | | TPCH(42) | TPCH-Q11 | parquet / none / none | 0.94 | 0.98 | -4.37% | 3.84% | 3.51% | 50 | -5.38% | -5.79 | -6.09 | | TPCH(42) | TPCH-Q20 | parquet / none / none | 1.93 | 2.05 | I -5.68% | 1.95% | 1.94% | 50 | I -5.36% | -8.16 | -15.04 | | TPCH(42) | TPCH-Q5 | parquet / none / none | 2.65 | 2.80 | I -5.41% | 0.88% | 0.95% | 50 | I -5.73% | -8.53 | -30.35 | | TPCH(42) | TPCH-Q19 | parquet / none / none | 2.18 | 2.34 | I -6.83% | 0.94% | 1.16% | 50 | I -6.99% | -8.53 | -33.18 | | TPCH(42) | TPCH-Q17 | parquet / none / none | 2.51 | 2.73 | I -7.78% | 4.75% | 6.01% | 50 | I -8.05% | -6.33 | -7.40 | | TPCH(42) | TPCH-Q2 | parquet / none / none | 1.17 | 1.26 | I -7.34% | 3.52% | 3.66% | 50 | I -8.50% | -7.91 | -10.58 | +----------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+--------+ (I) Improvement: TPCH(42) TPCH-Q21 [parquet / none / none] (21.94s -> 20.73s [-5.47%]) +---------------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +---------------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+---------+-----------+ | 10:HASH JOIN | 7.39% | 2.11s | 2.17s | -2.59% | 2.59% | 2.37s | 2.54s | -6.61% | 3 | 3 | 165.49K | 330.05K | | 09:HASH JOIN | 6.96% | 1.99s | 2.05s | -3.07% | 2.22% | 2.20s | 2.34s | -6.15% | 3 | 3 | 2.95M | 330.05K | | 00:SCAN HDFS | 2.97% | 848.08ms | 888.90ms | -4.59% | 2.54% | 900.00ms | 984.00ms | -8.54% | 1 | 1 | 16.70K | 420.00K | | 06:HASH JOIN | 5.88% | 1.68s | 2.05s | -18.09% | 2.96% | 1.86s | 3.35s | -44.32% | 3 | 3 | 3.06M | 8.40M | | F03:EXCHANGE SENDER | 4.32% | 1.23s | 1.16s | +6.06% | 2.44% | 1.36s | 1.38s | -1.16% | 3 | 3 | -1 | -1 | | F02:EXCHANGE SENDER | 2.82% | 805.03ms | 1.54s | -47.63% | 4.28% | 996.00ms | 5.40s | -81.54% | 3 | 3 | -1 | -1 | | 01:SCAN HDFS | 4.02% | 1.15s | 1.06s | +8.16% | 3.15% | 1.40s | 1.39s | +0.58% | 3 | 3 | 6.29M | 25.20M | | F01:EXCHANGE SENDER | 15.22% | 4.35s | 4.34s | +0.32% | 0.75% | 4.60s | 4.74s | -2.95% | 3 | 3 | -1 | -1 | | 04:SCAN HDFS | 4.22% | 1.21s | 1.20s | +0.62% | 2.08% | 1.42s | 1.34s | +5.67% | 3 | 3 | 158.47M | 252.01M | | 18:EXCHANGE | 2.39% | 683.57ms | 681.06ms | +0.37% | 4.75% | 836.00ms | 836.00ms | -0.00% | 3 | 3 | 159.33M | 25.20M | | F00:EXCHANGE SENDER | 39.14% | 11.19s | 11.25s | -0.50% | 0.78% | 11.82s | 11.84s | -0.17% | 3 | 3 | -1 | -1 | +---------------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+---------+-----------+ (I) Improvement: TPCH(42) TPCH-Q20 [parquet / none / none] (2.05s -> 1.93s [-5.68%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | 03:SCAN HDFS | 9.90% | 220.76ms | 226.99ms | -2.75% | 4.87% | 308.00ms | 300.00ms | +2.67% | 3 | 3 | 91.66K | 840.00K | | 02:SCAN HDFS | 15.59% | 347.65ms | 376.33ms | -7.62% | 6.80% | 432.00ms | 472.00ms | -8.47% | 3 | 3 | 14.68K | 33.60M | | 05:AGGREGATE | 3.11% | 69.31ms | 66.88ms | +3.62% | * 15.30% * | 144.00ms | 108.00ms | +33.33% | 3 | 3 | 13.76K | 25.20M | | 04:SCAN HDFS | 67.63% | 1.51s | 1.60s | -5.79% | 1.86% | 1.68s | 1.78s | -5.62% | 3 | 3 | 16.51K | 25.20M | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ (I) Improvement: TPCH(42) TPCH-Q5 [parquet / none / none] (2.80s -> 2.65s [-5.41%]) +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | 04:SCAN HDFS | 13.60% | 648.82ms | 694.45ms | -6.57% | 1.40% | 676.00ms | 724.00ms | -6.63% | 1 | 1 | 5 | 25 | | 00:SCAN HDFS | 14.47% | 690.12ms | 744.84ms | -7.35% | 2.41% | 760.00ms | 816.00ms | -6.86% | 3 | 3 | 1.26M | 6.30M | | 03:SCAN HDFS | 14.99% | 714.78ms | 769.71ms | -7.14% | 2.40% | 764.00ms | 808.00ms | -5.45% | 1 | 1 | 84.10K | 420.00K | | 06:HASH JOIN | 7.63% | 363.89ms | 367.24ms | -0.91% | 6.55% | 460.00ms | 436.00ms | +5.51% | 3 | 3 | 1.55M | 25.20M | | F01:EXCHANGE SENDER | 2.18% | 104.00ms | 98.42ms | +5.67% | * 12.48% * | 160.00ms | 148.00ms | +8.11% | 3 | 3 | -1 | -1 | | 01:SCAN HDFS | 21.19% | 1.01s | 1.08s | -6.72% | 2.74% | 1.15s | 1.22s | -5.57% | 3 | 3 | 1.94M | 6.30M | | 02:SCAN HDFS | 21.78% | 1.04s | 1.11s | -6.45% | 1.86% | 1.14s | 1.20s | -4.98% | 3 | 3 | 2.73M | 252.01M | +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ (I) Improvement: TPCH(42) TPCH-Q19 [parquet / none / none] (2.34s -> 2.18s [-6.83%]) +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+--------+-----------+ | 01:SCAN HDFS | 16.15% | 181.63ms | 183.70ms | -1.13% | 3.41% | 240.00ms | 240.00ms | +0.00% | 3 | 3 | 20.33K | 60.14K | | 00:SCAN HDFS | 80.28% | 903.08ms | 956.25ms | -5.56% | 2.47% | 964.00ms | 1.03s | -6.23% | 3 | 3 | 13.07K | 8.30M | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+--------+-----------+ (I) Improvement: TPCH(42) TPCH-Q17 [parquet / none / none] (2.73s -> 2.51s [-7.78%]) +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+---------+-----------+ | 00:SCAN HDFS | 27.67% | 969.17ms | 1.04s | -6.38% | 2.94% | 1.12s | 1.22s | -7.89% | 3 | 3 | 256.56K | 252.01M | | 08:AGGREGATE | 9.36% | 327.97ms | 376.98ms | -13.00% | * 12.50% * | 440.00ms | 520.00ms | -15.38% | 3 | 3 | 4.18M | 8.70M | | F00:EXCHANGE SENDER | 4.93% | 172.79ms | 198.29ms | -12.86% | * 17.36% * | 264.00ms | 312.00ms | -15.38% | 3 | 3 | -1 | -1 | | 03:AGGREGATE | 8.27% | 289.61ms | 350.18ms | -17.30% | * 15.25% * | 412.00ms | 520.00ms | -20.77% | 3 | 3 | 5.17M | 8.70M | | 02:SCAN HDFS | 44.91% | 1.57s | 1.65s | -4.84% | 1.70% | 2.16s | 2.25s | -3.74% | 3 | 3 | 6.02M | 252.01M | +---------------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+---------+-----------+ (I) Improvement: TPCH(42) TPCH-Q2 [parquet / none / none] (1.26s -> 1.17s [-7.34%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Inst | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ | 03:SCAN HDFS | 15.15% | 444.49ms | 466.04ms | -4.62% | * 10.92% * | 544.00ms | 560.00ms | -2.86% | 1 | 1 | 5 | 25 | | 01:SCAN HDFS | 15.30% | 448.82ms | 469.06ms | -4.32% | 9.56% | 532.00ms | 612.00ms | -13.07% | 1 | 1 | 84.23K | 420.00K | | 00:SCAN HDFS | 3.43% | 100.57ms | 108.03ms | -6.90% | * 10.35% * | 152.00ms | 172.00ms | -11.63% | 3 | 3 | 33.42K | 53.13K | | 02:SCAN HDFS | 17.31% | 507.78ms | 556.55ms | -8.76% | 6.65% | 648.00ms | 708.00ms | -8.47% | 3 | 3 | 26.62K | 33.60M | | 07:SCAN HDFS | 14.32% | 419.92ms | 433.39ms | -3.11% | * 10.51% * | 532.00ms | 556.00ms | -4.32% | 1 | 1 | 5 | 25 | | 06:SCAN HDFS | 14.52% | 425.96ms | 456.16ms | -6.62% | 9.71% | 540.00ms | 584.00ms | -7.53% | 1 | 1 | 84.23K | 420.00K | | 05:SCAN HDFS | 15.01% | 440.22ms | 466.75ms | -5.68% | * 13.29% * | 620.00ms | 616.00ms | +0.65% | 3 | 3 | 26.60K | 33.60M | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+--------+-----------+ Significant perf change detected.