Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4533

HDFS table sink operator doesn't show up in query summary

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • Impala 2.5.0
    • None
    • Backend

    Description

      HDFS Table sink operator doesn't show up in query summary, also the "Plan" tab doesn't show the table sink operator.

      Plan

      WRITE TO HDFS [tpcds_1000_parquet.store_sales_insert, OVERWRITE=false, PARTITION-KEYS=(ss_sold_date_sk,ss_quantity)]
      |  partitions=180576
      |  hosts=15 per-host-mem=17.88GB
      |
      02:SORT
      |  order by: ss_sold_date_sk DESC NULLS LAST, ss_quantity DESC NULLS LAST
      |  hosts=15 per-host-mem=1.45GB
      |  tuple-ids=1 row-size=100B cardinality=2879987999
      |
      01:EXCHANGE [HASH(ss_sold_date_sk,ss_quantity)]
      |  hosts=15 per-host-mem=0B
      |  tuple-ids=0 row-size=100B cardinality=2879987999
      |
      00:SCAN HDFS [tpcds_1000_parquet.store_sales, RANDOM]
         partitions=1824/1824 files=1824 size=189.24GB
         table stats: 2879987999 rows total
         column stats: all
         hosts=15 per-host-mem=88.00MB
         tuple-ids=0 row-size=100B cardinality=2879987999
      

      Summary

      Operator       #Hosts  Avg Time  Max Time  #Rows  Est. #Rows   Peak Mem  Est. Peak Mem  Detail                         
      -----------------------------------------------------------------------------------------------------------------------
      02:SORT            15     5m48s     7m41s  2.88B       2.88B   12.80 GB        1.45 GB                                 
      01:EXCHANGE        15  16s162ms  54s575ms  2.88B       2.88B          0              0  HASH(ss_sold_date_sk,ss_qua... 
      00:SCAN HDFS       15     1m45s     3m40s  2.88B       2.88B  193.92 MB       88.00 MB  tpcds_1000_parquet.store_sales
      

      Attachments

        Activity

          People

            Unassigned Unassigned
            mmokhtar Mostafa Mokhtar
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: