Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-2418

Increase the number of characters dedicated to the Detail column in query profile

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • Impala 2.3.0
    • Impala 2.10.0
    • Clients

    Description

      When the query profile get's printed out the "Detail" column is limited to 32 characters which means that lots of crucial information is hidden from the user.

      Check how the table names is missing in the table below

      Operator              #Hosts   Avg Time   Max Time    #Rows  Est. #Rows   Peak Mem  Est. Peak Mem  Detail                         
      ----------------------------------------------------------------------------------------------------------------------------------
      29:MERGING-EXCHANGE        1  183.622us  183.622us      400         100          0        -1.00 B  UNPARTITIONED                  
      18:TOP-N                   4    5.584ms    6.438ms      400         100    9.12 MB       24.76 KB                                 
      17:HASH JOIN               4   20s198ms   20s251ms   47.11K      80.00M    1.01 GB      334.90 MB  LEFT SEMI JOIN, BROADCAST      
      |--28:EXCHANGE             4  387.613ms   443.11ms   11.83M      19.95M          0              0  BROADCAST                      
      |  27:AGGREGATE            4    1s133ms    1s180ms   11.83M      19.95M  321.47 MB       83.73 MB  FINALIZE                       
      |  26:EXCHANGE             4   93.907ms   99.850ms   11.83M      19.95M          0              0  HASH(PS_PARTKEY)               
      |  12:AGGREGATE            4    1s873ms    2s240ms   11.83M      19.95M  391.22 MB      334.90 MB                                 
      |  11:HASH JOIN            4  681.138ms  725.206ms   16.04M      80.00M    2.00 MB        34.00 B  INNER JOIN, BROADCAST          
      |  |--25:EXCHANGE          4   13.489us   13.891us        1           1          0              0  BROADCAST                      
      |  |  08:SCAN HDFS         1   21.797ms   21.797ms        1           1   47.00 KB       32.00 MB  tpch_bin_flat_parquet_100.r... 
      |  10:HASH JOIN            4    1s087ms    1s175ms   80.00M      80.00M    2.06 MB       441.00 B  INNER JOIN, BROADCAST          
      |  |--24:EXCHANGE          4   15.384us   17.639us       25          25          0              0  BROADCAST                      
      |  |  07:SCAN HDFS         1    2.767ms    2.767ms       25          25   38.00 KB       32.00 MB  tpch_bin_flat_parquet_100.n... 
      |  09:HASH JOIN            4    4s073ms    4s323ms   80.00M      80.00M  299.00 MB       16.78 MB  INNER JOIN, BROADCAST          
      |  |--23:EXCHANGE          4   30.202ms   30.800ms    1.00M       1.00M          0              0  BROADCAST                      
      |  |  06:SCAN HDFS         3   11.409ms   17.403ms    1.00M       1.00M    8.32 MB       64.00 MB  tpch_bin_flat_parquet_100.s... 
      |  05:SCAN HDFS            4    1s482ms    2s282ms   80.00M      80.00M  228.70 MB      264.00 MB  tpch_bin_flat_parquet_100.p... 
      16:HASH JOIN               4   10.371ms   11.260ms   63.83K      80.00M    9.13 MB        34.00 B  INNER JOIN, BROADCAST          
      |--22:EXCHANGE             4   15.133us     18.8us        1           1          0              0  BROADCAST                      
      |  04:SCAN HDFS            1   14.851ms   14.851ms        1           1   47.00 KB       32.00 MB  tpch_bin_flat_parquet_100.r... 
      15:HASH JOIN               4   15.634ms   16.591ms  318.36K      80.00M    9.50 MB        1.05 KB  INNER JOIN, BROADCAST          
      |--21:EXCHANGE             4    14.29us   14.542us       25          25          0              0  BROADCAST                      
      |  03:SCAN HDFS            1    3.518ms    3.518ms       25          25   63.00 KB       48.00 MB  tpch_bin_flat_parquet_100.n... 
      14:HASH JOIN               4  881.999ms    1s365ms  318.36K      80.00M  427.00 MB      218.72 MB  INNER JOIN, BROADCAST          
      |--20:EXCHANGE             4   53.594ms   56.839ms    1.00M       1.00M          0              0  BROADCAST                      
      |  01:SCAN HDFS            3   91.481ms  122.847ms    1.00M       1.00M   92.25 MB      224.00 MB  tpch_bin_flat_parquet_100.s... 
      13:HASH JOIN               4    1s288ms    2s164ms  318.36K      80.00M   13.09 MB        3.47 MB  INNER JOIN, BROADCAST          
      |--19:EXCHANGE             4    2.485ms    2.923ms   79.59K      40.00K          0              0  BROADCAST                      
      |  00:SCAN HDFS            4    1s055ms    1s277ms   79.59K      40.00K   37.90 MB      352.00 MB  tpch_bin_flat_parquet_100.part 
      02:SCAN HDFS               4  353.936ms  816.426ms   80.00M      80.00M  228.86 MB      264.00 MB  tpch_bin_flat_parquet_100.p... 
      

      Attachments

        Issue Links

          Activity

            People

              tianyiwang Tianyi Wang
              mmokhtar Mostafa Mokhtar
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: