Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-11118

report_benchmark_results.py uses wrong compression codec in the per-query table

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.1.0
    • Infrastructure
    • None
    • ghx-label-6

    Description

      When running single_node_perf_run.sh, I got results like this

      +------------+--------------------+---------+------------+------------+----------------+
      | Workload   | File Format        | Avg (s) | Delta(Avg) | GeoMean(s) | Delta(GeoMean) |
      +------------+--------------------+---------+------------+------------+----------------+
      | TPCDS(100) | orc / snap / block | 25.41   | -14.62%    | 8.42       | -15.27%        |
      +------------+--------------------+---------+------------+------------+----------------+
      
      +------------+-------------+---------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+------+
      | Workload   | Query       | File Format         | Avg(s) | Base Avg(s) | Delta(Avg) | StdDev(%) | Base StdDev(%) | Iters | Median Diff(%) | MW Zval | Tval |
      +------------+-------------+---------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+------+
      | TPCDS(100) | TPCDS-Q59   | orc / block / block | 18.99  | 15.57       |   +21.94%  |   0.00%   |   0.00%        | 2     |   +17.99%      | 1.00    | 0    |
      | TPCDS(100) | TPCDS-Q90   | orc / block / block | 3.26   | 2.75        |   +18.70%  |   0.00%   |   0.00%        | 2     |   +15.75%      | 1.00    | 0    |
      | TPCDS(100) | TPCDS-Q1    | orc / block / block | 5.46   | 4.66        |   +17.30%  |   0.00%   |   0.00%        | 2     |   +14.75%      | 1.00    | 0    |
      ......
      | TPCDS(100) | TPCDS-Q80A  | orc / block / block | 24.71  | 76.83       |   -67.83%  |   0.00%   |   0.00%        | 2     |   -210.88%     | -1.00   | 0    |
      | TPCDS(100) | TPCDS-Q39-2 | orc / block / block | 4.83   | 17.31       |   -72.09%  |   0.00%   |   0.00%        | 2     |   -258.26%     | -1.00   | 0    |
      | TPCDS(100) | TPCDS-Q39-1 | orc / block / block | 4.92   | 17.93       |   -72.59%  |   0.00%   |   0.00%        | 2     |   -264.85%     | -1.00   | 0    |
      +------------+-------------+---------------------+--------+-------------+------------+-----------+----------------+-------+----------------+---------+------+
      

      The file format in the per-query table should be "orc/snap/block" instead of "orc/block/block".

      Attachments

        Activity

          People

            stigahuang Quanlong Huang
            stigahuang Quanlong Huang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: