Report Generated on 2017-10-18 Run Description: "c189d0a39cfb106f369522c57926196cc772da5e vs 39970138a6a9720d7e3599dc2a991b4ca85144f9" Cluster Name: UNKNOWN Lab Run Info: UNKNOWN Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE (2017-10-10) +-------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-------------------+-----------------------+---------+------------+------------+----------------+ | TARGETED-PERF(10) | parquet / none / none | 3.11 | -3.69% | 0.87 | -8.91% | +-------------------+-----------------------+---------+------------+------------+----------------+ +-------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | TARGETED-PERF(10) | primitive_conjunct_ordering_1 | parquet / none / none | 0.11 | 0.11 | +7.37% | * 25.90% * | * 34.51% * | 1 | 30 | | TARGETED-PERF(10) | primitive_exchange_broadcast | parquet / none / none | 4.96 | 4.84 | +2.49% | 4.21% | 3.73% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_string_non_selective | parquet / none / none | 0.32 | 0.31 | +2.17% | * 11.06% * | * 10.13% * | 1 | 30 | | TARGETED-PERF(10) | primitive_conjunct_ordering_5 | parquet / none / none | 2.42 | 2.39 | +1.31% | 2.39% | 2.35% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q5 | parquet / none / none | 0.87 | 0.86 | +1.27% | 4.79% | 3.84% | 1 | 30 | | TARGETED-PERF(10) | primitive_groupby_decimal_lowndv.test | parquet / none / none | 0.41 | 0.41 | +1.12% | 9.40% | 8.25% | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q6 | parquet / none / none | 0.39 | 0.38 | +1.12% | 7.58% | 3.49% | 1 | 30 | | TARGETED-PERF(10) | primitive_orderby_bigint | parquet / none / none | 0.71 | 0.70 | +0.99% | 7.51% | 6.27% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_bigint_non_selective | parquet / none / none | 0.23 | 0.23 | +0.54% | 8.60% | 7.26% | 1 | 30 | | TARGETED-PERF(10) | primitive_small_join_1 | parquet / none / none | 0.18 | 0.18 | +0.54% | 6.10% | 5.74% | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q2 | parquet / none / none | 0.81 | 0.81 | +0.35% | 6.34% | 5.73% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q2 | parquet / none / none | 0.65 | 0.65 | +0.29% | 4.51% | 5.40% | 1 | 30 | | TARGETED-PERF(10) | primitive_conjunct_ordering_3 | parquet / none / none | 0.21 | 0.21 | +0.18% | * 13.06% * | * 14.70% * | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q4 | parquet / none / none | 1.40 | 1.40 | +0.14% | 3.62% | 4.34% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q3 | parquet / none / none | 0.72 | 0.72 | +0.14% | 4.55% | 5.20% | 1 | 30 | | TARGETED-PERF(10) | primitive_top-n_all | parquet / none / none | 17.13 | 17.14 | -0.04% | 0.46% | 0.35% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_string_like | parquet / none / none | 2.77 | 2.78 | -0.11% | 2.73% | 2.06% | 1 | 30 | | TARGETED-PERF(10) | primitive_shuffle_join_one_to_many_string_with_groupby | parquet / none / none | 18.89 | 18.93 | -0.21% | 1.22% | 1.11% | 1 | 30 | | TARGETED-PERF(10) | primitive_long_predicate | parquet / none / none | 44.67 | 44.81 | -0.31% | 0.62% | 0.79% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q4 | parquet / none / none | 0.71 | 0.72 | -0.33% | 3.99% | 4.84% | 1 | 30 | | TARGETED-PERF(10) | primitive_topn_bigint | parquet / none / none | 1.39 | 1.39 | -0.47% | 3.22% | 2.08% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q7 | parquet / none / none | 1.43 | 1.44 | -0.48% | 2.93% | 3.45% | 1 | 30 | | TARGETED-PERF(10) | primitive_groupby_bigint_pk | parquet / none / none | 10.59 | 10.64 | -0.54% | 0.74% | 0.73% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q1 | parquet / none / none | 0.60 | 0.60 | -0.57% | 5.22% | 5.89% | 1 | 30 | | TARGETED-PERF(10) | primitive_shuffle_join_union_all_with_groupby | parquet / none / none | 7.07 | 7.11 | -0.58% | 1.68% | 1.22% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_string_selective | parquet / none / none | 0.27 | 0.27 | -0.61% | * 10.06% * | * 14.05% * | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q5 | parquet / none / none | 0.55 | 0.55 | -0.95% | 5.33% | 5.36% | 1 | 30 | | TARGETED-PERF(10) | primitive_groupby_bigint_highndv | parquet / none / none | 2.51 | 2.54 | -1.09% | 1.87% | 1.81% | 1 | 30 | | TARGETED-PERF(10) | primitive_orderby_all | parquet / none / none | 3.70 | 3.75 | -1.14% | 1.74% | 1.72% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_decimal_non_selective | parquet / none / none | 0.34 | 0.35 | -1.47% | 8.96% | 9.32% | 1 | 30 | | TARGETED-PERF(10) | primitive_groupby_bigint_lowndv | parquet / none / none | 0.42 | 0.42 | -1.48% | * 10.59% * | * 10.70% * | 1 | 30 | | TARGETED-PERF(10) | primitive_conjunct_ordering_2 | parquet / none / none | 1.74 | 1.77 | -1.59% | 2.26% | 3.29% | 1 | 30 | | TARGETED-PERF(10) | primitive_groupby_decimal_highndv | parquet / none / none | 2.70 | 2.75 | -1.94% | 4.13% | 3.22% | 1 | 30 | | TARGETED-PERF(10) | primitive_exchange_shuffle | parquet / none / none | 6.82 | 6.97 | -2.15% | 2.61% | 3.47% | 1 | 30 | | TARGETED-PERF(10) | PERF_STRING-Q6 | parquet / none / none | 1.88 | 1.92 | -2.20% | 2.71% | 2.35% | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q7 | parquet / none / none | 0.39 | 0.40 | -2.63% | 6.69% | 7.23% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_in_predicate | parquet / none / none | 0.45 | 0.47 | -3.48% | 8.18% | 7.17% | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q1 | parquet / none / none | 0.39 | 0.41 | -4.15% | 5.66% | 9.25% | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_decimal_selective | parquet / none / none | 0.31 | 0.32 | -4.16% | 8.58% | * 11.43% * | 1 | 30 | | TARGETED-PERF(10) | primitive_filter_bigint_selective | parquet / none / none | 0.12 | 0.13 | -4.83% | 3.86% | * 10.16% * | 1 | 30 | | TARGETED-PERF(10) | PERF_AGG-Q3 | parquet / none / none | 0.77 | 0.82 | -6.10% | 6.30% | 8.84% | 1 | 30 | | TARGETED-PERF(10) | primitive_conjunct_ordering_4 | parquet / none / none | 0.25 | 0.26 | -6.20% | 9.70% | * 12.52% * | 1 | 30 | | TARGETED-PERF(10) | PERF_LIMIT-Q1 | parquet / none / none | 0.01 | 0.01 | -8.43% | * 14.25% * | * 16.86% * | 1 | 30 | | TARGETED-PERF(10) | primitive_broadcast_join_3 | parquet / none / none | 1.42 | 2.57 | I -44.84% | 2.55% | 3.97% | 1 | 30 | | TARGETED-PERF(10) | primitive_broadcast_join_2 | parquet / none / none | 0.42 | 1.12 | I -62.12% | 8.91% | 3.84% | 1 | 30 | | TARGETED-PERF(10) | primitive_broadcast_join_1 | parquet / none / none | 0.20 | 0.58 | I -65.87% | * 13.47% * | 6.94% | 1 | 30 | | TARGETED-PERF(10) | primitive_empty_build_join_1 | parquet / none / none | 0.94 | 3.71 | I -74.79% | 2.56% | 1.92% | 1 | 30 | +-------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ (I) Improvement: TARGETED-PERF(10) primitive_broadcast_join_3 [parquet / none / none] (2.57s -> 1.42s [-44.84%]) +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | 11:EXCHANGE | 54.55% | 1.35s | 2.51s | -46.33% | 2.40% | 1.45s | 2.82s | -48.40% | 1 | 3 | 1 | | 06:HASH JOIN | 12.97% | 320.16ms | 3.67ms | +8634.88% | 9.04% | 426.46ms | 32.61ms | +1207.68% | 3 | 0 | 6 | | 10:EXCHANGE | 6.73% | 166.09ms | 499.73ms | -66.76% | 8.56% | 211.74ms | 1.03s | -79.45% | 3 | 4.56M | 1.50M | | 00:SCAN HDFS | 20.67% | 510.14ms | 2.00s | -74.49% | 5.96% | 564.41ms | 2.36s | -76.13% | 3 | 0 | 59.99M | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ (I) Improvement: TARGETED-PERF(10) primitive_broadcast_join_2 [parquet / none / none] (1.12s -> 0.42s [-62.12%]) +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | 08:EXCHANGE | 83.76% | 366.58ms | 1.07s | -65.60% | 4.75% | 409.85ms | 1.16s | -64.55% | 1 | 3 | 1 | +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ (I) Improvement: TARGETED-PERF(10) primitive_broadcast_join_1 [parquet / none / none] (0.58s -> 0.20s [-65.87%]) +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | 05:EXCHANGE | 99.00% | 156.12ms | 530.57ms | -70.57% | 9.18% | 182.75ms | 609.80ms | -70.03% | 1 | 3 | 1 | +-------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ (I) Improvement: TARGETED-PERF(10) primitive_empty_build_join_1 [parquet / none / none] (3.71s -> 0.94s [-74.79%]) +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ | 04:EXCHANGE | 39.00% | 889.98ms | 3.66s | -75.69% | 1.86% | 915.53ms | 3.90s | -76.51% | 1 | 0 | 4 | | 03:EXCHANGE | 28.90% | 659.45ms | 669.52ms | -1.50% | 2.80% | 708.98ms | 719.30ms | -1.44% | 3 | 0 | 1 | | 01:SCAN HDFS | 32.06% | 731.56ms | 731.60ms | -0.01% | 1.64% | 855.88ms | 860.58ms | -0.55% | 3 | 0 | 1 | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+-------+-----------+ (V) Significant Variability: TARGETED-PERF(10) primitive_conjunct_ordering_1 [parquet / none / none] (34.51% -> 25.90%) +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 01:EXCHANGE | 98.65% | 22.53% | 21.15% | +6.52% | 1 | 0 | 1 | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ (V) Significant Variability: TARGETED-PERF(10) PERF_LIMIT-Q1 [parquet / none / none] (16.86% -> 14.25%) No Nodes with significant StdDev % (V) Significant Variability: TARGETED-PERF(10) primitive_broadcast_join_1 [parquet / none / none] (6.94% -> 13.47%) No Nodes with significant StdDev % (V) Significant Variability: TARGETED-PERF(10) primitive_conjunct_ordering_3 [parquet / none / none] (14.70% -> 13.06%) +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 05:EXCHANGE | 63.88% | 11.07% | 11.03% | +0.43% | 1 | 3 | 1 | | 03:EXCHANGE | 35.34% | 17.11% | 12.97% | +31.87% | 3 | 0 | 1.29M | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ (V) Significant Variability: TARGETED-PERF(10) primitive_filter_string_non_selective [parquet / none / none] (10.13% -> 11.06%) No Nodes with significant StdDev % (V) Significant Variability: TARGETED-PERF(10) primitive_groupby_bigint_lowndv [parquet / none / none] (10.70% -> 10.59%) +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ | 04:EXCHANGE | 38.35% | 10.46% | 10.41% | +0.49% | 1 | 0 | 1 | | 02:EXCHANGE | 32.71% | 11.51% | 11.52% | -0.03% | 3 | 21 | 7 | | 00:SCAN HDFS | 2.89% | 10.59% | 14.11% | -24.92% | 3 | 59.99M | 59.99M | +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ (V) Significant Variability: TARGETED-PERF(10) primitive_filter_string_selective [parquet / none / none] (14.05% -> 10.06%) No Nodes with significant StdDev % Significant perf change detected