Full Perf Run Report ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpch_300_decimal_parquet (Query Iterations: 3 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +------------+-----------------------+---------+------------+------------+----------------+ | TPCH(_300) | parquet / none / none | 18.71 | -1.52% | 9.54 | -0.64% | +------------+-----------------------+---------+------------+------------+----------------+ +------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | TPCH(_300) | TPCH-Q6 | parquet / none / none | 1.36 | 1.31 | +4.11% | 3.90% | 0.12% | 1 | 3 | | TPCH(_300) | TPCH-Q2 | parquet / none / none | 1.92 | 1.85 | +3.61% | 1.52% | 4.83% | 1 | 3 | | TPCH(_300) | TPCH-Q3 | parquet / none / none | 28.94 | 28.06 | +3.14% | 0.46% | 1.94% | 1 | 3 | | TPCH(_300) | TPCH-Q21 | parquet / none / none | 100.61 | 97.76 | +2.91% | 0.58% | 2.52% | 1 | 3 | | TPCH(_300) | TPCH-Q16 | parquet / none / none | 5.98 | 5.82 | +2.82% | 0.04% | 1.57% | 1 | 3 | | TPCH(_300) | TPCH-Q20 | parquet / none / none | 3.31 | 3.22 | +2.68% | 2.40% | 0.43% | 1 | 3 | | TPCH(_300) | TPCH-Q9 | parquet / none / none | 30.07 | 29.42 | +2.21% | 1.70% | 2.59% | 1 | 3 | | TPCH(_300) | TPCH-Q14 | parquet / none / none | 4.15 | 4.08 | +1.76% | 0.72% | 1.26% | 1 | 3 | | TPCH(_300) | TPCH-Q7 | parquet / none / none | 42.79 | 42.20 | +1.39% | 1.50% | 0.87% | 1 | 3 | | TPCH(_300) | TPCH-Q4 | parquet / none / none | 5.12 | 5.08 | +0.68% | 0.59% | 0.95% | 1 | 3 | | TPCH(_300) | TPCH-Q1 | parquet / none / none | 21.76 | 21.84 | -0.33% | 0.83% | 0.47% | 1 | 3 | | TPCH(_300) | TPCH-Q8 | parquet / none / none | 6.93 | 6.95 | -0.43% | 2.65% | 0.35% | 1 | 3 | | TPCH(_300) | TPCH-Q15 | parquet / none / none | 3.53 | 3.55 | -0.80% | 1.42% | 1.50% | 1 | 3 | | TPCH(_300) | TPCH-Q22 | parquet / none / none | 6.08 | 6.13 | -0.82% | 0.47% | 0.41% | 1 | 3 | | TPCH(_300) | TPCH-Q18 | parquet / none / none | 31.65 | 31.96 | -0.96% | 1.53% | 1.11% | 1 | 3 | | TPCH(_300) | TPCH-Q11 | parquet / none / none | 1.70 | 1.72 | -1.16% | 3.17% | 1.66% | 1 | 3 | | TPCH(_300) | TPCH-Q17 | parquet / none / none | 5.58 | 5.70 | -2.14% | 3.12% | 1.78% | 1 | 3 | | TPCH(_300) | TPCH-Q13 | parquet / none / none | 21.96 | 22.46 | -2.24% | 0.03% | 1.37% | 1 | 3 | | TPCH(_300) | TPCH-Q10 | parquet / none / none | 9.06 | 9.33 | -2.92% | 0.91% | 1.14% | 1 | 3 | | TPCH(_300) | TPCH-Q12 | parquet / none / none | 3.37 | 3.53 | -4.67% | 0.57% | 0.02% | 1 | 3 | | TPCH(_300) | TPCH-Q19 | parquet / none / none | 27.73 | 30.07 | -7.76% | 1.62% | 2.63% | 1 | 3 | | TPCH(_300) | TPCH-Q5 | parquet / none / none | 48.11 | 55.98 | -14.07% | 0.63% | * 13.84% * | 1 | 3 | +------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - Primitives tpch_300_decimal_parquet (Query Iterations: 3 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +---------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +---------------------+-----------------------+---------+------------+------------+----------------+ | TARGETED-PERF(_300) | parquet / none / none | 36.37 | -0.51% | 9.90 | -1.46% | +---------------------+-----------------------+---------+------------+------------+----------------+ +---------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +---------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | TARGETED-PERF(_300) | primitive_groupby_decimal_highndv | parquet / none / none | 24.95 | 22.85 | +9.17% | 0.56% | 4.93% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_selective | parquet / none / none | 0.38 | 0.35 | +7.93% | 6.14% | 1.43% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_5 | parquet / none / none | 37.70 | 34.93 | +7.93% | 0.50% | 8.35% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_3 | parquet / none / none | 53.92 | 51.29 | +5.11% | 2.19% | 0.77% | 1 | 3 | | TARGETED-PERF(_300) | primitive_exchange_broadcast | parquet / none / none | 81.25 | 78.35 | +3.71% | 0.15% | 1.84% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_1 | parquet / none / none | 1.01 | 0.98 | +2.95% | 0.14% | 2.26% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_3 | parquet / none / none | 1.07 | 1.04 | +2.88% | 0.23% | 2.25% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_in_list | parquet / none / none | 0.92 | 0.90 | +2.71% | 2.85% | 5.55% | 1 | 3 | | TARGETED-PERF(_300) | primitive_empty_build_join_1 | parquet / none / none | 6.80 | 6.63 | +2.61% | 3.04% | 0.46% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_bigint_non_selective | parquet / none / none | 1.10 | 1.07 | +2.30% | 0.00% | 2.27% | 1 | 3 | | TARGETED-PERF(_300) | primitive_shuffle_join_union_all_with_groupby | parquet / none / none | 66.45 | 64.98 | +2.26% | 1.00% | 5.48% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_decimal_lowndv.test | parquet / none / none | 3.37 | 3.30 | +2.06% | 3.08% | 0.54% | 1 | 3 | | TARGETED-PERF(_300) | primitive_many_independent_fragments | parquet / none / none | 191.32 | 187.67 | +1.95% | 0.36% | 0.90% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_bigint_expression | parquet / none / none | 19.06 | 18.80 | +1.40% | 0.25% | 0.69% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_lowndv | parquet / none / none | 3.27 | 3.24 | +0.94% | 0.07% | 0.71% | 1 | 3 | | TARGETED-PERF(_300) | primitive_exchange_shuffle | parquet / none / none | 77.13 | 76.51 | +0.81% | 2.88% | 0.42% | 1 | 3 | | TARGETED-PERF(_300) | primitive_many_fragments | parquet / none / none | 64.54 | 64.25 | +0.45% | 0.40% | 0.95% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_decimal_selective | parquet / none / none | 0.60 | 0.60 | +0.19% | 0.04% | 0.08% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_non_selective | parquet / none / none | 0.90 | 0.90 | +0.10% | 5.30% | 5.28% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_decimal_non_selective | parquet / none / none | 0.91 | 0.91 | +0.03% | 0.44% | 0.31% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_selective | parquet / none / none | 0.55 | 0.55 | -0.33% | 0.01% | 0.45% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_pk | parquet / none / none | 90.39 | 90.74 | -0.38% | 0.99% | 3.78% | 1 | 3 | | TARGETED-PERF(_300) | primitive_shuffle_join_one_to_many_string_with_groupby | parquet / none / none | 236.92 | 237.98 | -0.45% | 0.74% | 0.73% | 1 | 3 | | TARGETED-PERF(_300) | primitive_topn_bigint | parquet / none / none | 5.29 | 5.32 | -0.53% | 0.87% | 0.12% | 1 | 3 | | TARGETED-PERF(_300) | primitive_decimal_arithmetic | parquet / none / none | 97.43 | 98.57 | -1.16% | 0.25% | 0.20% | 1 | 3 | | TARGETED-PERF(_300) | primitive_top-n_all | parquet / none / none | 36.76 | 37.29 | -1.40% | 1.45% | 1.18% | 1 | 3 | | TARGETED-PERF(_300) | primitive_broadcast_join_2 | parquet / none / none | 4.31 | 4.38 | -1.70% | 0.48% | 0.22% | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_in_predicate | parquet / none / none | 1.04 | 1.06 | -1.85% | 5.20% | 6.94% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_4 | parquet / none / none | 0.86 | 0.88 | -2.28% | 0.05% | 3.04% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_1 | parquet / none / none | 4.68 | 4.80 | -2.56% | 1.06% | 1.62% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_all | parquet / none / none | 55.00 | 56.81 | -3.19% | 1.97% | 0.61% | 1 | 3 | | TARGETED-PERF(_300) | primitive_intrinsic_to_date | parquet / none / none | 78.50 | 81.42 | -3.58% | 0.36% | 0.29% | 1 | 3 | | TARGETED-PERF(_300) | primitive_groupby_bigint_highndv | parquet / none / none | 23.74 | 24.81 | -4.30% | 0.31% | 0.61% | 1 | 3 | | TARGETED-PERF(_300) | primitive_intrinsic_appx_median | parquet / none / none | 32.55 | 34.05 | -4.42% | 0.13% | 2.73% | 1 | 3 | | TARGETED-PERF(_300) | primitive_conjunct_ordering_2 | parquet / none / none | 27.03 | 29.25 | -7.59% | 0.16% | 2.66% | 1 | 3 | | TARGETED-PERF(_300) | primitive_long_predicate | parquet / none / none | 29.71 | 33.59 | -11.55% | 0.35% | 0.70% | 1 | 3 | | TARGETED-PERF(_300) | primitive_orderby_bigint | parquet / none / none | 15.32 | 18.21 | -15.83% | 3.08% | * 13.10% * | 1 | 3 | | TARGETED-PERF(_300) | primitive_filter_string_like | parquet / none / none | 5.50 | 10.11 | I -45.61% | 0.48% | * 48.32% * | 1 | 3 | +---------------------+--------------------------------------------------------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ (I) Improvement: TARGETED-PERF(_300) primitive_filter_string_like [parquet / none / none] (10.11s -> 5.50s [-45.61%]) +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ | 01:AGGREGATE | 11.61% | 587.88ms | 923.48ms | -36.34% | 0.05% | 646.27ms | 10.08s | -93.59% | 14 | 14 | 1 | | 00:SCAN HDFS | 88.39% | 4.48s | 4.42s | +1.24% | 1.20% | 4.84s | 4.82s | +0.56% | 14 | 47.35M | 180.00M | +--------------+------------+----------+----------+------------+-----------+----------+----------+------------+--------+--------+-----------+ Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpcds_1000_decimal_parquet (Query Iterations: 3 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +--------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +--------------+-----------------------+---------+------------+------------+----------------+ | TPCDS(_1000) | parquet / none / none | 14.23 | +5.22% | 4.64 | +2.44% | +--------------+-----------------------+---------+------------+------------+----------------+ +--------------+------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +--------------+------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | TPCDS(_1000) | TPCDS-Q2 | parquet / none / none | 27.11 | 9.34 | R +190.38% | * 83.62% * | * 49.10% * | 1 | 3 | | TPCDS(_1000) | TPCDS-Q64 | parquet / none / none | 43.38 | 40.21 | +7.88% | 0.54% | 1.31% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q42 | parquet / none / none | 1.14 | 1.08 | +5.51% | 2.78% | 2.17% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q28 | parquet / none / none | 8.15 | 7.79 | +4.64% | 0.26% | 0.27% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q68 | parquet / none / none | 1.54 | 1.48 | +4.47% | 0.44% | 1.20% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q6 | parquet / none / none | 65.81 | 63.24 | +4.08% | 2.24% | 1.28% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q59 | parquet / none / none | 6.38 | 6.16 | +3.47% | 1.34% | 0.78% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q55 | parquet / none / none | 1.11 | 1.08 | +3.36% | 0.42% | 0.76% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q79 | parquet / none / none | 5.03 | 4.90 | +2.68% | 1.33% | 2.22% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q4 | parquet / none / none | 33.26 | 32.46 | +2.47% | 1.80% | 0.89% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q27a | parquet / none / none | 3.40 | 3.33 | +2.04% | 1.42% | 0.93% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q34 | parquet / none / none | 2.35 | 2.32 | +1.51% | 0.16% | 0.63% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q65 | parquet / none / none | 32.11 | 31.71 | +1.27% | 1.81% | 2.48% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q3 | parquet / none / none | 1.17 | 1.15 | +1.07% | 0.90% | 0.49% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q53 | parquet / none / none | 1.74 | 1.72 | +0.82% | 2.79% | 1.22% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q96 | parquet / none / none | 2.52 | 2.51 | +0.72% | 0.02% | 0.88% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q27 | parquet / none / none | 2.50 | 2.48 | +0.71% | 1.64% | 1.02% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q52 | parquet / none / none | 0.94 | 0.94 | +0.02% | 0.12% | 0.06% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q46 | parquet / none / none | 2.43 | 2.43 | -0.02% | 1.07% | 0.88% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q1 | parquet / none / none | 4.11 | 4.12 | -0.23% | 0.95% | 0.77% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q23 | parquet / none / none | 152.13 | 152.55 | -0.28% | 1.10% | 0.02% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q73 | parquet / none / none | 1.86 | 1.86 | -0.42% | 0.24% | 0.60% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q5 | parquet / none / none | 9.34 | 9.40 | -0.69% | 1.93% | 0.04% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q89 | parquet / none / none | 2.70 | 2.73 | -1.10% | 0.11% | 0.96% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q19 | parquet / none / none | 1.77 | 1.79 | -1.14% | 1.44% | 1.97% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q88 | parquet / none / none | 8.45 | 8.56 | -1.39% | 0.13% | 0.45% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q43 | parquet / none / none | 4.45 | 4.52 | -1.51% | 0.02% | 2.06% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q8 | parquet / none / none | 1.36 | 1.39 | -1.95% | 1.95% | 0.01% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q98 | parquet / none / none | 2.18 | 2.24 | -2.87% | 0.83% | 0.63% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q63 | parquet / none / none | 1.69 | 1.75 | -3.12% | 3.04% | 2.95% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q7 | parquet / none / none | 2.85 | 2.95 | -3.39% | 0.06% | 2.24% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q61 | parquet / none / none | 2.10 | 2.19 | -3.80% | 0.30% | 1.68% | 1 | 3 | | TPCDS(_1000) | TPCDS-Q47 | parquet / none / none | 32.40 | 33.80 | -4.15% | 0.33% | 2.49% | 1 | 3 | +--------------+------------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ (R) Regression: TPCDS(_1000) TPCDS-Q2 [parquet / none / none] (9.34s -> 27.11s [+190.38%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | 13:AGGREGATE | 6.16% | 1.54s | 1.51s | +1.84% | 1.20% | 1.72s | 1.71s | +0.86% | 14 | 528 | 10.64K | | 12:HASH JOIN | 3.61% | 901.20ms | 886.70ms | +1.64% | 1.04% | 991.31ms | 998.02ms | -0.67% | 14 | 433.27M | 2.16B | | 11:SCAN HDFS | 2.01% | 500.01ms | 369.25ms | +35.41% | * 14.40% * | 572.02ms | 370.36ms | +54.45% | 1 | 371 | 73.05K | | 06:SCAN HDFS | 3.60% | 897.80ms | 879.12ms | +2.12% | 1.16% | 908.18ms | 890.05ms | +2.04% | 1 | 365 | 373 | | 05:AGGREGATE | 17.87% | 4.46s | 4.40s | +1.26% | * 65.13% * | 7.98s | 7.50s | +6.48% | 14 | 529 | 10.64K | | 04:HASH JOIN | 10.01% | 2.50s | 2.50s | -0.19% | * 60.44% * | 4.29s | 4.27s | +0.41% | 14 | 442.29M | 2.16B | | 03:SCAN HDFS | 3.64% | 907.91ms | 886.68ms | +2.39% | 0.07% | 908.52ms | 887.10ms | +2.41% | 1 | 12.66K | 73.05K | | 02:SCAN HDFS | 46.55% | 11.61s | 190.35ms | +5997.81% | * 99.24% * | 31.00s | 377.38ms | +8113.19% | 14 | 294.36M | 1.44B | | 01:SCAN HDFS | 5.71% | 1.43s | 113.64ms | +1154.02% | * 96.16% * | 36.74s | 233.25ms | +15653.02% | 14 | 147.93M | 720.00M | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ (V) Significant Variability: TPCDS(_1000) TPCDS-Q2 [parquet / none / none] (49.10% -> 83.62%) +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ | 11:SCAN HDFS | 2.01% | 14.40% | 0.30% | +4662.50% | 1 | 371 | 73.05K | | 05:AGGREGATE | 17.87% | 65.13% | 63.94% | +1.85% | 14 | 529 | 10.64K | | 04:HASH JOIN | 10.01% | 60.44% | 57.87% | +4.45% | 14 | 442.29M | 2.16B | | 02:SCAN HDFS | 46.55% | 99.24% | 55.84% | +77.74% | 14 | 294.36M | 1.44B | | 01:SCAN HDFS | 5.71% | 96.16% | 54.68% | +75.85% | 14 | 147.93M | 720.00M | +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpch_nested_300_parquet (Query Iterations: 3 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +-------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-------------------+-----------------------+---------+------------+------------+----------------+ | TPCH_NESTED(_300) | parquet / none / none | 30.78 | +0.33% | 12.14 | +1.51% | +-------------------+-----------------------+---------+------------+------------+----------------+ +-------------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-------------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | TPCH_NESTED(_300) | TPCH-Q8 | parquet / none / none | 10.53 | 9.50 | +10.89% | 4.05% | 1.56% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q16 | parquet / none / none | 13.27 | 12.58 | +5.49% | 1.94% | 3.88% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q20 | parquet / none / none | 11.23 | 10.65 | +5.43% | 0.16% | 1.71% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q18 | parquet / none / none | 75.43 | 72.48 | +4.06% | 2.04% | 0.86% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q2 | parquet / none / none | 4.76 | 4.60 | +3.36% | 1.41% | 0.51% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q12 | parquet / none / none | 6.33 | 6.14 | +3.20% | 0.39% | 1.21% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q14 | parquet / none / none | 4.76 | 4.65 | +2.24% | 2.70% | 0.56% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q22 | parquet / none / none | 1.30 | 1.28 | +1.92% | 0.24% | 1.68% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q10 | parquet / none / none | 9.57 | 9.42 | +1.59% | 0.22% | 0.78% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q4 | parquet / none / none | 6.77 | 6.69 | +1.24% | 0.06% | 0.43% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q13 | parquet / none / none | 10.72 | 10.62 | +0.98% | 1.84% | 0.98% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q15 | parquet / none / none | 4.79 | 4.75 | +0.92% | 2.68% | 1.82% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q9 | parquet / none / none | 209.76 | 208.56 | +0.58% | 1.08% | 0.13% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q11 | parquet / none / none | 2.02 | 2.01 | +0.49% | 0.59% | 0.03% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q6 | parquet / none / none | 1.89 | 1.89 | +0.06% | 1.27% | 1.32% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q5 | parquet / none / none | 7.71 | 7.72 | -0.13% | 0.65% | 0.38% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q19 | parquet / none / none | 30.44 | 30.54 | -0.31% | 1.53% | 0.39% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q3 | parquet / none / none | 7.21 | 7.25 | -0.56% | 1.13% | 0.34% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q21 | parquet / none / none | 47.57 | 47.95 | -0.80% | 0.04% | 0.03% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q1 | parquet / none / none | 21.61 | 21.97 | -1.64% | 0.65% | 0.23% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q17 | parquet / none / none | 139.37 | 142.10 | -1.92% | 1.69% | 1.74% | 1 | 3 | | TPCH_NESTED(_300) | TPCH-Q7 | parquet / none / none | 50.22 | 51.69 | -2.84% | 0.94% | 0.05% | 1 | 3 | +-------------------+----------+-----------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpcds_1000_decimal_parquet un-modified queries (Query Iterations: 3 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +-------------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-------------------------+-----------------------+---------+------------+------------+----------------+ | TPCDS-UNMODIFIED(_1000) | parquet / none / none | 14.70 | -0.61% | 6.13 | -1.06% | +-------------------------+-----------------------+---------+------------+------------+----------------+ +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | TPCDS-UNMODIFIED(_1000) | TPCDS-Q12 | parquet / none / none | 1.48 | 1.37 | +7.99% | 0.48% | 0.43% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q77 | parquet / none / none | 4.39 | 4.17 | +5.30% | 4.12% | 3.50% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q86 | parquet / none / none | 5.54 | 5.29 | +4.75% | 4.09% | 0.44% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q25 | parquet / none / none | 5.05 | 4.83 | +4.68% | 2.61% | 0.53% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q32 | parquet / none / none | 1.77 | 1.69 | +4.50% | 0.57% | 0.31% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q5 | parquet / none / none | 9.74 | 9.34 | +4.25% | 1.12% | 0.89% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q34 | parquet / none / none | 2.42 | 2.32 | +4.10% | 0.32% | 0.84% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q63 | parquet / none / none | 2.06 | 1.99 | +3.82% | 1.42% | 1.01% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q78 | parquet / none / none | 175.86 | 169.60 | +3.69% | 0.04% | 1.04% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q74 | parquet / none / none | 18.50 | 17.85 | +3.66% | 2.75% | 1.22% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q68 | parquet / none / none | 1.99 | 1.93 | +3.60% | 1.08% | 1.89% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q60 | parquet / none / none | 4.15 | 4.01 | +3.54% | 2.50% | 0.38% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q80 | parquet / none / none | 9.06 | 8.76 | +3.45% | 0.52% | 1.27% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q66 | parquet / none / none | 3.41 | 3.29 | +3.43% | 0.53% | 1.09% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q42 | parquet / none / none | 1.13 | 1.09 | +3.29% | 2.12% | 0.17% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q54 | parquet / none / none | 7.65 | 7.42 | +3.02% | 1.08% | 0.08% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q52 | parquet / none / none | 1.11 | 1.08 | +2.88% | 1.81% | 0.24% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q84 | parquet / none / none | 12.85 | 12.52 | +2.67% | 4.79% | 0.61% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q18 | parquet / none / none | 8.38 | 8.18 | +2.41% | 0.20% | 0.34% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q72 | parquet / none / none | 51.28 | 50.08 | +2.39% | 0.55% | 2.78% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q40 | parquet / none / none | 2.65 | 2.59 | +2.31% | 0.94% | 0.03% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q81 | parquet / none / none | 3.81 | 3.72 | +2.29% | 3.19% | 1.52% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q28 | parquet / none / none | 7.97 | 7.80 | +2.16% | 0.80% | 0.46% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q55 | parquet / none / none | 1.10 | 1.08 | +2.15% | 2.71% | 0.73% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q85 | parquet / none / none | 11.47 | 11.23 | +2.14% | 2.73% | 3.37% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q26 | parquet / none / none | 2.47 | 2.42 | +2.13% | 0.85% | 0.76% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q93 | parquet / none / none | 68.40 | 67.13 | +1.89% | 0.52% | 0.49% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q17 | parquet / none / none | 9.97 | 9.79 | +1.83% | 0.06% | 0.62% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q35 | parquet / none / none | 6.75 | 6.63 | +1.82% | 0.49% | 0.52% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q20 | parquet / none / none | 1.52 | 1.50 | +1.58% | 0.31% | 1.77% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q39 | parquet / none / none | 8.04 | 7.92 | +1.48% | 0.34% | 0.73% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q30 | parquet / none / none | 2.91 | 2.87 | +1.46% | 0.15% | 0.18% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q22 | parquet / none / none | 40.63 | 40.13 | +1.24% | 3.13% | 1.05% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q56 | parquet / none / none | 2.38 | 2.36 | +1.20% | 1.48% | 0.13% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q27 | parquet / none / none | 3.68 | 3.64 | +1.13% | 1.91% | 0.48% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q53 | parquet / none / none | 2.05 | 2.03 | +0.95% | 0.13% | 1.35% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q64 | parquet / none / none | 42.93 | 42.56 | +0.86% | 0.92% | 0.02% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q11 | parquet / none / none | 26.55 | 26.36 | +0.73% | 0.40% | 0.09% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q29 | parquet / none / none | 5.70 | 5.66 | +0.70% | 0.42% | 0.09% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q87 | parquet / none / none | 19.82 | 19.70 | +0.61% | 0.76% | 1.54% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q50 | parquet / none / none | 8.49 | 8.44 | +0.58% | 0.08% | 1.33% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q33 | parquet / none / none | 2.94 | 2.92 | +0.40% | 0.12% | 1.52% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q45 | parquet / none / none | 1.72 | 1.72 | +0.40% | 1.82% | 1.70% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q46 | parquet / none / none | 2.43 | 2.43 | +0.31% | 0.27% | 0.43% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q31 | parquet / none / none | 6.27 | 6.25 | +0.28% | 0.57% | 1.60% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q41 | parquet / none / none | 1.07 | 1.06 | +0.22% | 0.06% | 0.00% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q49 | parquet / none / none | 6.26 | 6.25 | +0.20% | 1.55% | 1.53% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q59 | parquet / none / none | 14.76 | 14.75 | +0.09% | * 57.85% * | * 57.66% * | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q92 | parquet / none / none | 1.38 | 1.38 | +0.01% | 0.21% | 0.98% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q15 | parquet / none / none | 5.29 | 5.30 | -0.02% | 0.67% | 1.44% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q44 | parquet / none / none | 4.04 | 4.04 | -0.04% | 0.05% | 0.43% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q13 | parquet / none / none | 13.26 | 13.29 | -0.20% | 0.57% | 1.58% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q75 | parquet / none / none | 24.33 | 24.41 | -0.30% | 0.65% | 1.70% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q91 | parquet / none / none | 1.43 | 1.44 | -0.35% | 0.06% | 0.27% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q16 | parquet / none / none | 4.76 | 4.78 | -0.37% | 1.03% | 1.30% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q6 | parquet / none / none | 65.78 | 66.04 | -0.39% | 1.20% | 0.08% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q1 | parquet / none / none | 3.73 | 3.75 | -0.42% | 0.79% | 0.75% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q23 | parquet / none / none | 123.32 | 123.87 | -0.45% | 0.31% | 1.15% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q21 | parquet / none / none | 4.10 | 4.12 | -0.52% | 0.58% | 0.04% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q69 | parquet / none / none | 2.99 | 3.01 | -0.56% | 0.53% | 2.60% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q51 | parquet / none / none | 34.25 | 34.46 | -0.61% | 2.33% | 0.27% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q7 | parquet / none / none | 2.87 | 2.89 | -0.74% | 1.98% | 0.67% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q62 | parquet / none / none | 4.27 | 4.31 | -1.00% | 1.83% | 0.49% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q65 | parquet / none / none | 32.34 | 32.70 | -1.12% | 1.74% | 0.29% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q3 | parquet / none / none | 1.35 | 1.36 | -1.17% | 0.64% | 1.45% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q70 | parquet / none / none | 13.28 | 13.44 | -1.22% | 1.73% | 0.08% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q76 | parquet / none / none | 6.80 | 6.89 | -1.26% | 0.23% | 0.85% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q14 | parquet / none / none | 157.55 | 159.62 | -1.29% | 1.00% | 1.15% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q10 | parquet / none / none | 2.99 | 3.03 | -1.32% | 0.95% | 1.16% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q90 | parquet / none / none | 1.68 | 1.70 | -1.36% | 0.18% | 0.18% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q61 | parquet / none / none | 1.92 | 1.95 | -1.44% | 1.68% | 0.88% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q9 | parquet / none / none | 5.50 | 5.58 | -1.56% | 0.29% | 0.47% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q37 | parquet / none / none | 3.83 | 3.89 | -1.56% | 0.67% | 0.68% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q88 | parquet / none / none | 8.37 | 8.50 | -1.57% | 0.41% | 0.02% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q73 | parquet / none / none | 1.82 | 1.85 | -1.57% | 2.88% | 0.93% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q47 | parquet / none / none | 31.33 | 31.87 | -1.71% | 2.70% | 2.36% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q95 | parquet / none / none | 5.36 | 5.46 | -1.81% | 0.56% | 0.50% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q38 | parquet / none / none | 38.88 | 39.61 | -1.84% | 0.37% | 0.57% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q98 | parquet / none / none | 2.66 | 2.72 | -2.13% | 3.50% | 0.97% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q57 | parquet / none / none | 17.59 | 17.99 | -2.23% | 1.70% | 1.01% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q82 | parquet / none / none | 4.48 | 4.58 | -2.30% | 0.52% | 0.39% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q36 | parquet / none / none | 5.20 | 5.35 | -2.75% | 0.48% | 1.33% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q79 | parquet / none / none | 7.32 | 7.53 | -2.81% | 0.75% | 1.09% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q71 | parquet / none / none | 5.84 | 6.01 | -2.88% | 2.92% | 0.88% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q89 | parquet / none / none | 3.08 | 3.18 | -3.13% | 0.66% | 0.94% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q94 | parquet / none / none | 3.32 | 3.43 | -3.15% | 0.37% | 4.20% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q97 | parquet / none / none | 31.82 | 32.90 | -3.29% | 0.82% | 1.92% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q19 | parquet / none / none | 1.70 | 1.76 | -3.45% | 0.78% | 0.50% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q48 | parquet / none / none | 1.73 | 1.79 | -3.46% | 0.16% | 0.11% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q96 | parquet / none / none | 2.46 | 2.56 | -3.65% | 0.93% | 1.38% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q43 | parquet / none / none | 4.58 | 4.80 | -4.57% | 2.67% | 0.55% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q99 | parquet / none / none | 7.17 | 7.54 | -4.90% | 1.86% | 0.67% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q4 | parquet / none / none | 32.93 | 34.87 | -5.56% | 0.84% | 4.94% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q8 | parquet / none / none | 1.77 | 2.11 | -15.90% | 1.38% | 0.37% | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q83 | parquet / none / none | 4.23 | 5.16 | -18.03% | * 48.14% * | * 23.61% * | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q58 | parquet / none / none | 27.10 | 35.18 | I -22.96% | * 56.84% * | * 37.25% * | 1 | 3 | | TPCDS-UNMODIFIED(_1000) | TPCDS-Q2 | parquet / none / none | 9.35 | 12.77 | I -26.83% | * 52.76% * | * 10.84% * | 1 | 3 | +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ (I) Improvement: TPCDS-UNMODIFIED(_1000) TPCDS-Q58 [parquet / none / none] (35.18s -> 27.10s [-22.96%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | 18:HASH JOIN | 2.64% | 1.06s | 2.05s | -48.50% | * 99.04% * | 2.16s | 2.23s | -3.19% | 14 | 3.17M | 133.31K | | 17:HASH JOIN | 3.33% | 1.33s | 2.60s | -48.60% | * 99.42% * | 2.79s | 2.76s | +1.08% | 14 | 3.17M | 1.42B | | 12:SCAN HDFS | 2.20% | 880.39ms | 917.63ms | -4.06% | 3.25% | 909.04ms | 927.71ms | -2.01% | 1 | 7 | 73.05K | | 16:HASH JOIN | 16.06% | 6.43s | 13.07s | -50.78% | * 98.76% * | 15.02s | 17.47s | -14.05% | 14 | 3.17M | 1.42B | | 28:HASH JOIN | 2.60% | 1.04s | 6.08ms | +17001.28% | 2.43% | 1.14s | 23.56ms | +4719.90% | 14 | 1.59M | 66.66K | | 27:HASH JOIN | 3.29% | 1.32s | 5.24ms | +25006.12% | 3.08% | 1.44s | 14.35ms | +9953.04% | 14 | 719.82M | 710.06M | | 22:SCAN HDFS | 2.22% | 888.65ms | 891.76ms | -0.35% | 2.14% | 907.67ms | 911.48ms | -0.42% | 1 | 73.05K | 73.05K | | 26:HASH JOIN | 15.78% | 6.32s | 79.35ms | +7860.97% | 4.45% | 7.83s | 144.66ms | +5311.57% | 14 | 719.82M | 710.06M | | 21:SCAN HDFS | 2.15% | 860.25ms | 910.73ms | -5.54% | 1.13% | 869.93ms | 911.03ms | -4.51% | 1 | 300.00K | 300.00K | | 08:HASH JOIN | 5.02% | 2.01s | 2.01s | +0.00% | * 99.14% * | 4.16s | 4.23s | -1.75% | 14 | 6.08M | 266.62K | | 07:HASH JOIN | 6.34% | 2.54s | 2.55s | -0.30% | * 99.49% * | 5.15s | 5.46s | -5.59% | 14 | 6.08M | 2.84B | | 02:SCAN HDFS | 2.17% | 870.42ms | 899.09ms | -3.19% | 0.19% | 872.10ms | 906.91ms | -3.84% | 1 | 7 | 73.05K | | 06:HASH JOIN | 29.81% | 11.94s | 11.24s | +6.19% | * 98.98% * | 30.17s | 31.26s | -3.49% | 14 | 6.08M | 2.84B | | 01:SCAN HDFS | 2.08% | 831.62ms | 861.53ms | -3.47% | 0.07% | 832.19ms | 871.41ms | -4.50% | 1 | 300.00K | 300.00K | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ (I) Improvement: TPCDS-UNMODIFIED(_1000) TPCDS-Q2 [parquet / none / none] (12.77s -> 9.35s [-26.83%]) +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ | 13:AGGREGATE | 12.61% | 1.51s | 1.49s | +1.68% | 0.27% | 1.71s | 1.64s | +4.04% | 14 | 528 | 10.64K | | 12:HASH JOIN | 7.42% | 890.97ms | 872.70ms | +2.09% | 0.62% | 1.00s | 948.70ms | +5.88% | 14 | 433.27M | 2.16B | | 11:SCAN HDFS | 3.31% | 397.85ms | 369.78ms | +7.59% | 2.31% | 407.05ms | 371.02ms | +9.71% | 1 | 371 | 73.05K | | 06:SCAN HDFS | 7.48% | 898.19ms | 877.62ms | +2.34% | 1.12% | 908.23ms | 886.74ms | +2.42% | 1 | 365 | 373 | | 05:AGGREGATE | 36.63% | 4.40s | 6.39s | -31.14% | * 64.96% * | 7.70s | 7.41s | +3.87% | 14 | 2.59K | 10.64K | | 04:HASH JOIN | 20.78% | 2.50s | 3.60s | -30.69% | * 59.84% * | 4.40s | 4.20s | +4.77% | 14 | 2.15B | 2.16B | | 03:SCAN HDFS | 7.39% | 887.05ms | 867.27ms | +2.28% | 2.40% | 908.34ms | 887.24ms | +2.38% | 1 | 73.05K | 73.05K | +--------------+------------+----------+----------+------------+------------+----------+----------+------------+--------+---------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q59 [parquet / none / none] (57.66% -> 57.85%) +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 03:AGGREGATE | 44.18% | 67.98% | 67.51% | +0.69% | 14 | 1.02M | 5.21M | | 02:HASH JOIN | 15.84% | 61.68% | 61.10% | +0.96% | 14 | 2.75B | 2.88B | | 00:SCAN HDFS | 2.11% | 56.63% | 56.32% | +0.55% | 14 | 2.75B | 2.88B | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q58 [parquet / none / none] (37.25% -> 56.84%) +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 18:HASH JOIN | 2.64% | 99.04% | 1.32% | +7429.71% | 14 | 3.17M | 133.31K | | 17:HASH JOIN | 3.33% | 99.42% | 1.18% | +8319.66% | 14 | 3.17M | 1.42B | | 16:HASH JOIN | 16.06% | 98.76% | 1.76% | +5517.74% | 14 | 3.17M | 1.42B | | 08:HASH JOIN | 5.02% | 99.14% | 99.11% | +0.03% | 14 | 6.08M | 266.62K | | 07:HASH JOIN | 6.34% | 99.49% | 99.49% | -0.00% | 14 | 6.08M | 2.84B | | 06:HASH JOIN | 29.81% | 98.98% | 98.94% | +0.03% | 14 | 6.08M | 2.84B | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q2 [parquet / none / none] (10.84% -> 52.76%) +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 05:AGGREGATE | 36.63% | 64.96% | 12.30% | +428.05% | 14 | 2.59K | 10.64K | | 04:HASH JOIN | 20.78% | 59.84% | 8.80% | +580.12% | 14 | 2.15B | 2.16B | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q83 [parquet / none / none] (23.61% -> 48.14%) +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ | 08:HASH JOIN | 3.46% | 95.33% | 95.42% | -0.09% | 14 | 3.51M | 79.98K | | 07:HASH JOIN | 3.83% | 97.03% | 97.08% | -0.05% | 14 | 3.51M | 284.02M | | 06:HASH JOIN | 20.15% | 91.35% | 92.20% | -0.92% | 14 | 3.51M | 284.02M | +--------------+------------+-----------+----------------+------------------+--------+-------+-----------+ Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpcds_1000_parquet_etl (Query Iterations: 1 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +------------------+-----------------------+---------+------------+------------+----------------+ | ETL-TPCDS(_1000) | parquet / none / none | 237.79 | -5.54% | 17.76 | +2.30% | +------------------+-----------------------+---------+------------+------------+----------------+ +------------------+-----------------------------------------+-----------------------+---------+-------------+------------+-----------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +------------------+-----------------------------------------+-----------------------+---------+-------------+------------+-----------+----------------+-------------+-------+ | ETL-TPCDS(_1000) | 17-TPCDS-SS-DROP-TABLE-UNPART | parquet / none / none | 21.76 | 15.77 | R +38.05% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 02-TPCDS-SS-INSERT-CREATE-TABLE | parquet / none / none | 6.54 | 5.26 | R +24.23% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 04-TPCDS-SS-COMPUTE-STATS | parquet / none / none | 51.90 | 47.90 | +8.34% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 06-TPCDS-SS-COMPUTE-STATS-SINGLE-ROW | parquet / none / none | 29.82 | 27.75 | +7.47% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 08-TPCDS-SS-DROP-TABLE-UNPART | parquet / none / none | 0.01 | 0.01 | +5.63% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 07-TPCDS-SS-INSERT-DROP-TABLE | parquet / none / none | 13.92 | 13.91 | +0.11% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 15-TPCDS-SS-CREATE-SORT-PART | parquet / none / none | 5.95 | 5.95 | -0.07% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 09-TPCDS-SS-CREATE-UNPART | parquet / none / none | 5.89 | 5.90 | -0.13% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 12-TPCDS-SS-CREATE-SORT | parquet / none / none | 5.95 | 5.97 | -0.24% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 01-TPCDS-SS-INSERT-DROP-TABLE | parquet / none / none | 0.08 | 0.08 | -0.40% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 11-TPCDS-SS-DROP-TABLE-UNPART | parquet / none / none | 5.87 | 5.90 | -0.40% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 14-TPCDS-SS-DROP-TABLE-UNPART | parquet / none / none | 5.87 | 5.91 | -0.61% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 10-TPCDS-SS-INSERT-UNPART | parquet / none / none | 408.03 | 426.08 | -4.24% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 13-TPCDS-SS-INSERT-SORT | parquet / none / none | 630.11 | 662.10 | -4.83% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 16-TPCDS-SS-INSERT-SORT-PART | parquet / none / none | 1432.33 | 1510.39 | -5.17% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 03-TPCDS-SS-INSERT-OVERWRITE | parquet / none / none | 1260.37 | 1362.37 | -7.49% | 0.00% | 0.00% | 1 | 2 | | ETL-TPCDS(_1000) | 05-TPCDS-SS-INSERT-OVERWRITE-SINGLE-ROW | parquet / none / none | 158.04 | 178.10 | -11.26% | 0.00% | 0.00% | 1 | 2 | +------------------+-----------------------------------------+-----------------------+---------+-------------+------------+-----------+----------------+-------------+-------+ (R) Regression: ETL-TPCDS(_1000) 17-TPCDS-SS-DROP-TABLE-UNPART [parquet / none / none] (15.77s -> 21.76s [+38.05%]) (R) Regression: ETL-TPCDS(_1000) 02-TPCDS-SS-INSERT-CREATE-TABLE [parquet / none / none] (5.26s -> 6.54s [+24.23%]) Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - metadata benchmars (Query Iterations: 1 Workload Iterations: 1 Num Clients: 1) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +-----------------------+--------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-----------------------+--------------------+---------+------------+------------+----------------+ | METADATA-BENCHMARKS() | text / none / none | 34.02 | -5.41% | 13.10 | +12.84% | +-----------------------+--------------------+---------+------------+------------+----------------+ +-----------------------+----------------------------------------------------------------+--------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-----------------------+----------------------------------------------------------------+--------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-01-DROP | text / none / none | 0.24 | 0.03 | R +816.02% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-01-DROP | text / none / none | 0.24 | 0.03 | R +811.50% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-06-INVALIDATE | text / none / none | 8.63 | 6.32 | R +36.58% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-06-INVALIDATE | text / none / none | 7.99 | 6.01 | R +33.08% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-09-INVALIDATE | text / none / none | 6.97 | 5.30 | R +31.59% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-11-DROP-PARTITION | text / none / none | 8.19 | 6.36 | R +28.76% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-11-DROP-PARTITION | text / none / none | 8.26 | 6.48 | R +27.35% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-05-QUERY-AFTER-INV | text / none / none | 58.31 | 52.52 | +11.03% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-07-REFRESH | text / none / none | 20.33 | 18.37 | +10.70% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-04-INVALIDATE | text / none / none | 6.29 | 6.04 | +4.26% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-10-REFRESH-AFTER-ADD-PARTITION | text / none / none | 146.12 | 141.25 | +3.45% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-02-CREATE | text / none / none | 7.20 | 7.12 | +1.13% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-05-QUERY-AFTER-INV | text / none / none | 16.63 | 16.57 | +0.36% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-03-RECOVER | text / none / none | 22.33 | 22.58 | -1.13% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-06-INVALIDATE | text / none / none | 5.92 | 6.02 | -1.70% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-11-REFRESH-PARTITION | text / none / none | 8.19 | 8.33 | -1.70% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-11-REFRESH-PARTITION | text / none / none | 8.23 | 8.37 | -1.74% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-07-REFRESH | text / none / none | 124.22 | 126.44 | -1.75% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-07-REFRESH | text / none / none | 138.68 | 141.37 | -1.90% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-09-INVALIDATE | text / none / none | 7.64 | 7.85 | -2.68% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-11-DROP-PARTITION | text / none / none | 18.07 | 18.66 | -3.17% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-10-REFRESH-AFTER-ADD-PARTITION | text / none / none | 19.83 | 20.54 | -3.45% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-11-REFRESH-PARTITION | text / none / none | 18.16 | 18.82 | -3.49% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-09-INVALIDATE | text / none / none | 5.64 | 5.86 | -3.73% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-12-DROP | text / none / none | 5.68 | 5.90 | -3.75% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-04-INVALIDATE | text / none / none | 5.64 | 5.86 | -3.76% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-12-DROP | text / none / none | 5.68 | 5.90 | -3.86% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-08-ADD-PARTITION | text / none / none | 6.29 | 6.55 | -4.05% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-03-RECOVER | text / none / none | 82.19 | 86.42 | -4.90% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-02-CREATE | text / none / none | 9.22 | 9.86 | -6.52% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-05-QUERY-AFTER-INV | text / none / none | 112.32 | 120.30 | -6.64% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-08-ADD-PARTITION | text / none / none | 21.69 | 23.33 | -7.04% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 100K-PARTITIONS-1M-FILES-CUSTOM-12-QUERY-PARTITIONS | text / none / none | 163.78 | 178.84 | -8.42% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-08-ADD-PARTITION | text / none / none | 6.16 | 8.37 | I -26.39% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-04-INVALIDATE | text / none / none | 5.66 | 7.86 | I -27.98% | 0.00% | 0.00% | 1 | 2 | | METADATA-BENCHMARKS() | 80-PARTITIONS-250K-FILES-S3-10-REFRESH-AFTER-ADD-PARTITION | text / none / none | 128.24 | 178.45 | I -28.14% | 0.00% | 0.00% | 1 | 2 | +-----------------------+----------------------------------------------------------------+--------------------+--------+-------------+------------+-----------+----------------+-------------+-------+ (R) Regression: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-S3-01-DROP [text / none / none] (0.03s -> 0.24s [+816.02%]) (R) Regression: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-01-DROP [text / none / none] (0.03s -> 0.24s [+811.50%]) (R) Regression: METADATA-BENCHMARKS() 100K-PARTITIONS-1M-FILES-CUSTOM-06-INVALIDATE [text / none / none] (6.32s -> 8.63s [+36.58%]) (R) Regression: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-06-INVALIDATE [text / none / none] (6.01s -> 7.99s [+33.08%]) (R) Regression: METADATA-BENCHMARKS() 100K-PARTITIONS-1M-FILES-CUSTOM-09-INVALIDATE [text / none / none] (5.30s -> 6.97s [+31.59%]) (R) Regression: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-S3-11-DROP-PARTITION [text / none / none] (6.36s -> 8.19s [+28.76%]) (R) Regression: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-11-DROP-PARTITION [text / none / none] (6.48s -> 8.26s [+27.35%]) (I) Improvement: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-S3-08-ADD-PARTITION [text / none / none] (8.37s -> 6.16s [-26.39%]) (I) Improvement: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-S3-04-INVALIDATE [text / none / none] (7.86s -> 5.66s [-27.98%]) (I) Improvement: METADATA-BENCHMARKS() 80-PARTITIONS-250K-FILES-S3-10-REFRESH-AFTER-ADD-PARTITION [text / none / none] (178.45s -> 128.24s [-28.14%]) Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpcds_1000_decimal_parquet Q17 96 concurrent users (Query Iterations: 2 Workload Iterations: 1 Num Clients: 96) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +-------------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-------------------------+-----------------------+---------+------------+------------+----------------+ | TPCDS-UNMODIFIED(_1000) | parquet / none / none | 423.31 | +30.21% | 411.73 | +37.73% | +-------------------------+-----------------------+---------+------------+------------+----------------+ +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | TPCDS-UNMODIFIED(_1000) | TPCDS-Q17 | parquet / none / none | 423.31 | 325.11 | R +30.21% | * 23.03% * | * 34.23% * | 96 | 2 | +-------------------------+-----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ (R) Regression: TPCDS-UNMODIFIED(_1000) TPCDS-Q17 [parquet / none / none] (325.11s -> 423.31s [+30.21%]) +--------------+------------+----------+----------+------------+------------+--------+----------+------------+--------+--------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+----------+----------+------------+------------+--------+----------+------------+--------+--------+-----------+ | 12:HASH JOIN | 12.53% | 5.47s | 4.64s | +17.77% | * 38.51% * | 32.14s | 29.50s | +8.96% | 14 | 579 | 13.49M | | 11:HASH JOIN | 3.12% | 1.36s | 1.18s | +15.86% | * 41.84% * | 21.07s | 19.62s | +7.38% | 14 | 6.16M | 13.49M | | 09:HASH JOIN | 40.57% | 17.71s | 15.31s | +15.69% | * 31.56% * | 46.22s | 41.86s | +10.41% | 14 | 6.16M | 100.39M | | 19:EXCHANGE | 7.93% | 3.46s | 2.86s | +21.13% | * 49.96% * | 27.37s | 24.25s | +12.87% | 14 | 48.53M | 288.00M | | 01:SCAN HDFS | 4.16% | 1.82s | 1.45s | +25.56% | * 27.79% * | 35.20s | 12.71s | +176.89% | 14 | 48.53M | 288.00M | | 18:EXCHANGE | 8.15% | 3.56s | 2.40s | +48.21% | * 29.32% * | 40.85s | 19.18s | +112.96% | 14 | 69.36M | 143.68M | | 08:HASH JOIN | 2.04% | 890.34ms | 808.87ms | +10.07% | * 18.41% * | 7.48s | 16.45s | -54.57% | 14 | 69.36M | 143.68M | | 00:SCAN HDFS | 6.21% | 2.71s | 2.46s | +10.39% | * 17.84% * | 10.83s | 20.38s | -46.87% | 14 | 69.36M | 2.88B | | 22:EXCHANGE | 4.79% | 2.09s | 2.12s | -1.58% | * 30.05% * | 26.43s | 18.33s | +44.21% | 14 | 60.72M | 1.44B | | 02:SCAN HDFS | 5.64% | 2.46s | 2.17s | +13.34% | * 67.17% * | 29.71s | 18.54s | +60.24% | 14 | 60.72M | 1.44B | +--------------+------------+----------+----------+------------+------------+--------+----------+------------+--------+--------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q17 [parquet / none / none] (34.23% -> 23.03%) +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ | 12:HASH JOIN | 12.53% | 38.51% | 36.19% | +6.41% | 14 | 579 | 13.49M | | 11:HASH JOIN | 3.12% | 41.84% | 36.65% | +14.16% | 14 | 6.16M | 13.49M | | 09:HASH JOIN | 40.57% | 31.56% | 25.67% | +22.93% | 14 | 6.16M | 100.39M | | 19:EXCHANGE | 7.93% | 49.96% | 56.47% | -11.54% | 14 | 48.53M | 288.00M | | 01:SCAN HDFS | 4.16% | 27.79% | 28.00% | -0.75% | 14 | 48.53M | 288.00M | | 18:EXCHANGE | 8.15% | 29.32% | 31.53% | -7.00% | 14 | 69.36M | 143.68M | | 08:HASH JOIN | 2.04% | 18.41% | 21.17% | -13.07% | 14 | 69.36M | 143.68M | | 00:SCAN HDFS | 6.21% | 17.84% | 18.48% | -3.44% | 14 | 69.36M | 2.88B | | 22:EXCHANGE | 4.79% | 30.05% | 30.36% | -1.01% | 14 | 60.72M | 1.44B | | 02:SCAN HDFS | 5.64% | 67.17% | 61.74% | +8.80% | 14 | 60.72M | 1.44B | +--------------+------------+-----------+----------------+------------------+--------+--------+-----------+ Significant perf change detected ==================================================================================================================================== Report Generated on 2017-07-11 Run Description: Nightly Perf Run - 16 Node CDH5 Cluster - tpcds_1000_decimal_parquet Q3 256 concurrent users (Query Iterations: 3 Workload Iterations: 1 Num Clients: 256) Cluster Name: 16 Node CDH5 (vb0202) Lab Run Info: reduce-io-mgr-buffering-origin/impala-4835-io-mgr-buffers-git://github.mtv.cloudera.com/tarmstrong/Impala.git Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE () Baseline Impala Version: impalad version 2.10.0-SNAPSHOT RELEASE (2017-07-04) +-------------------------+-----------------------+---------+------------+------------+----------------+ | Workload | File Format | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) | +-------------------------+-----------------------+---------+------------+------------+----------------+ | TPCDS-UNMODIFIED(_1000) | parquet / none / none | 125.09 | +45.52% | 116.87 | +51.47% | +-------------------------+-----------------------+---------+------------+------------+----------------+ +-------------------------+----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | Workload | Query | File Format | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Num Clients | Iters | +-------------------------+----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ | TPCDS-UNMODIFIED(_1000) | TPCDS-Q3 | parquet / none / none | 125.09 | 85.96 | R +45.52% | * 28.84% * | * 35.06% * | 256 | 3 | +-------------------------+----------+-----------------------+--------+-------------+------------+------------+----------------+-------------+-------+ (R) Regression: TPCDS-UNMODIFIED(_1000) TPCDS-Q3 [parquet / none / none] (85.96s -> 125.09s [+45.52%]) +--------------+------------+-------+----------+------------+------------+--------+----------+------------+--------+---------+-----------+ | Operator | % of Query | Avg | Base Avg | Delta(Avg) | StdDev(%) | Max | Base Max | Delta(Max) | #Hosts | #Rows | Est #Rows | +--------------+------------+-------+----------+------------+------------+--------+----------+------------+--------+---------+-----------+ | 01:SCAN HDFS | 96.20% | 3.04s | 7.14s | -57.44% | * 60.04% * | 21.67s | 54.40s | -60.16% | 14 | 148.46K | 2.88B | +--------------+------------+-------+----------+------------+------------+--------+----------+------------+--------+---------+-----------+ (V) Significant Variability: TPCDS-UNMODIFIED(_1000) TPCDS-Q3 [parquet / none / none] (35.06% -> 28.84%) +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ | Operator | % of Query | StdDev(%) | Base StdDev(%) | Delta(StdDev(%)) | #Hosts | #Rows | Est #Rows | +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ | 01:SCAN HDFS | 96.20% | 60.04% | 27.82% | +115.77% | 14 | 148.46K | 2.88B | +--------------+------------+-----------+----------------+------------------+--------+---------+-----------+ Significant perf change detected