Report Generated on 2017-11-03 Cluster Name: UNKNOWN Lab Run Info: UNKNOWN Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.11.0-SNAPSHOT RELEASE () +---------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +---------------------+-----------------------+---------+------------+------------+----------------+ | TARGETED-PERF(_300) | parquet / none / none | 59.40 | -0.76% | 9.08 | +1.28% | +---------------------+-----------------------+---------+------------+------------+----------------+ +---------------------+--------------------------------------------------------+-----------------------+---------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +---------------------+--------------------------------------------------------+-----------------------+---------+-------------+------------+------------+----------------+-------------+-------+ | TARGETED-PERF(_300) | primitive_filter_decimal_selective | parquet / none / none | 0.83 | 0.60 | R +39.10% | * 21.51% * | 0.48% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_in_predicate | parquet / none / none | 1.24 | 0.96 | R +28.94% | 0.24% | 2.38% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_non_selective | parquet / none / none | 0.95 | 0.80 | +18.87% | 8.77% | 0.32% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_bigint | parquet / none / none | 17.74 | 15.08 | +17.64% | 2.76% | 0.61% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_2 | parquet / none / none | 4.53 | 4.02 | +12.58% | 6.26% | 0.67% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_bigint_expression | parquet / none / none | 20.34 | 18.19 | +11.80% | 0.12% | 0.57% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_1 | parquet / none / none | 1.31 | 1.21 | +8.56% | 0.15% | * 21.13% * | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_1 | parquet / none / none | 5.11 | 4.91 | +4.01% | 5.41% | 5.44% | 1 | 3 | | TARGETED-PERF(_300) | primitive_empty_build_join_1 | parquet / none / none | 1.84 | 1.79 | +2.76% | 0.94% | 1.28% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_2 | parquet / none / none | 28.77 | 28.29 | +1.71% | 0.36% | 1.69% | 1 | 3 | | TARGETED-PERF(_300) | primitive_many_fragments | parquet / none / none | 59.80 | 58.97 | +1.41% | 0.05% | 0.44% | 1 | 3 | | TARGETED-PERF(_300) | primitive_count_star | parquet / none / none | 0.09 | 0.09 | +1.05% | 0.33% | 2.16% | 1 | 3 | | TARGETED-PERF(_300) | primitive_exchange_shuffle | parquet / none / none | 81.30 | 80.53 | +0.96% | 0.77% | 1.21% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_decimal_lowndv.test | parquet / none / none | 3.32 | 3.30 | +0.65% | 0.02% | 0.64% | 1 | 3 | | TARGETED-PERF(_300) | primitive_shuffle_join_union_all_with_groupby | parquet / none / none | 68.59 | 68.16 | +0.64% | 0.49% | 0.18% | 1 | 3 | | TARGETED-PERF(_300) | primitive_top-n_all | parquet / none / none | 36.94 | 36.77 | +0.46% | 0.17% | 1.51% | 1 | 3 | | TARGETED-PERF(_300) | primitive_topn_bigint | parquet / none / none | 5.52 | 5.52 | +0.06% | 0.23% | 0.27% | 1 | 3 | | TARGETED-PERF(_300) | primitive_decimal_arithmetic | parquet / none / none | 97.49 | 97.49 | +0.00% | 0.28% | 0.03% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_3 | parquet / none / none | 58.78 | 58.92 | -0.24% | 0.23% | 0.23% | 1 | 3 | | TARGETED-PERF(_300) | primitive_small_join_1 | parquet / none / none | 0.38 | 0.38 | -0.24% | 1.14% | 0.10% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_non_selective | parquet / none / none | 1.05 | 1.05 | -0.27% | 0.10% | 5.14% | 1 | 3 | | TARGETED-PERF(_300) | primitive_long_predicate | parquet / none / none | 29.33 | 29.41 | -0.30% | 0.32% | 0.23% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_highndv | parquet / none / none | 25.68 | 25.76 | -0.34% | 0.33% | 0.61% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_all | parquet / none / none | 55.27 | 55.65 | -0.68% | 0.20% | 0.32% | 1 | 3 | | TARGETED-PERF(_300) | primitive_exchange_broadcast | parquet / none / none | 81.12 | 81.72 | -0.74% | 4.66% | 1.61% | 1 | 3 | | TARGETED-PERF(_300) | primitive_shuffle_join_one_to_many_string_with_groupby | parquet / none / none | 228.49 | 230.36 | -0.81% | 0.78% | 1.17% | 1 | 3 | | TARGETED-PERF(_300) | primitive_many_independent_fragments | parquet / none / none | 232.19 | 234.27 | -0.89% | 4.58% | 1.13% | 1 | 3 | | TARGETED-PERF(_300) | primitive_intrinsic_to_date | parquet / none / none | 80.58 | 81.33 | -0.91% | 0.66% | 0.08% | 1 | 3 | | TARGETED-PERF(_300) | primitive_shuffle_1mb_rows | parquet / none / none | 1007.27 | 1020.40 | -1.29% | 1.95% | 0.78% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_pk | parquet / none / none | 96.27 | 97.91 | -1.68% | 0.02% | 0.00% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_in_list | parquet / none / none | 0.92 | 0.94 | -2.56% | 2.18% | 5.97% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_3 | parquet / none / none | 0.99 | 1.02 | -2.80% | 2.30% | 4.20% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_lowndv | parquet / none / none | 3.32 | 3.43 | -3.04% | 0.08% | 0.28% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_4 | parquet / none / none | 0.85 | 0.88 | -3.33% | 0.24% | 3.68% | 1 | 3 | | TARGETED-PERF(_300) | primitive_intrinsic_appx_median | parquet / none / none | 35.78 | 37.68 | -5.04% | 0.30% | 3.09% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_like | parquet / none / none | 5.63 | 5.94 | -5.10% | 0.10% | 5.99% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_5 | parquet / none / none | 31.47 | 33.43 | -5.86% | 1.98% | 1.70% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_decimal_highndv | parquet / none / none | 22.68 | 24.97 | -9.17% | 2.94% | 1.98% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_decimal_non_selective | parquet / none / none | 0.80 | 0.90 | -11.68% | 0.13% | 6.00% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_selective | parquet / none / none | 0.37 | 0.42 | -12.14% | 6.97% | 6.86% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_selective | parquet / none / none | 0.50 | 0.57 | -12.66% | 0.79% | * 13.54% * | 1 | 3 | +---------------------+--------------------------------------------------------+-----------------------+---------+-------------+------------+------------+----------------+-------------+-------+ (R) Regression: TARGETED-PERF(_300) primitive_filter_decimal_selective [parquet / none / none] (0.60s -> 0.83s [+39.10%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+ | 02:EXCHANGE | 61.17% | 762.85ms | 537.32ms | +41.97% | * 23.17% * | 939.61ms | 543.29ms | +72.95% | 1 | 14 | 1 | | 00:SCAN HDFS | 38.64% | 481.92ms | 459.32ms | +4.92% | 0.86% | 811.36ms | 497.07ms | +63.23% | 14 | 1.78K | 180.00M | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+-------+-----------+ (R) Regression: TARGETED-PERF(_300) primitive_filter_in_predicate [parquet / none / none] (0.96s -> 1.24s [+28.94%]) +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ | 02:EXCHANGE | 61.85% | 1.16s | 868.31ms | +33.08% | 0.76% | 1.16s | 881.57ms | +32.07% | 1 | 14 | 1 | | 01:AGGREGATE | 2.42% | 45.21ms | 2.29ms | +1873.39% | 1.91% | 325.93ms | 3.41ms | +9457.57% | 14 | 14 | 1 | | 00:SCAN HDFS | 35.71% | 667.20ms | 668.99ms | -0.27% | 0.67% | 777.29ms | 753.04ms | +3.22% | 14 | 13.67K | 14.38K | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ (V) Significant Variability: TARGETED-PERF(_300) primitive_filter_decimal_selective [parquet / none / none] (0.48% -> 21.51%) +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 02:EXCHANGE | 61.17% | 23.17% | 1.11% | +1983.65% | 1 | 14 | 1 | +-------------+------------+-----------+----------------+------------------+--------+-------+-----------+ Significant perf change detected