Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5282

Insert into a table partitioned by two column with clustered hint from a partitioned source table fails with IllegalStateException: null

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: Impala 2.8.0
    • Fix Version/s: Impala 2.10.0
    • Component/s: Frontend
    • Labels:
      None
    • Epic Color:
      ghx-label-4

      Description

      Query

      INSERT INTO scan_primitives_tpch_3tb.lineitem_partitioned_250K 
      partition(l_shipdate,l_orderkey_mod_100) /*+ clustered */
      SELECT
        l_orderkey,                                                                                                 
        l_partkey,                                                                                                  
        l_suppkey,                                                                                                  
        l_linenumber,                                                                                               
        l_quantity ,                                                                                                 
        l_extendedprice ,                                                                                            
        l_discount ,                                                                                                 
        l_tax ,                                                                                                      
        l_returnflag ,                                                                                               
        l_linestatus ,                                                                                               
        l_commitdate ,                                                                                               
        l_receiptdate ,                                                                                              
        l_shipinstruct ,                                                                                             
        l_shipmode ,                                                                                                 
        l_comment,
        l_shipdate, 
        l_orderkey % 100
      FROM scan_primitives_tpch_3tb.lineitem_partitioned;
      

      Destination table

       CREATE TABLE scan_primitives_tpch_3tb.lineitem_partitioned_250k (                                                          
         l_orderkey BIGINT,                                                                                                       
         l_partkey BIGINT,                                                                                                        
         l_suppkey BIGINT,                                                                                                        
         l_linenumber BIGINT,                                                                                                     
         l_quantity DOUBLE,                                                                                                       
         l_extendedprice DOUBLE,                                                                                                  
         l_discount DOUBLE,                                                                                                       
         l_tax DOUBLE,                                                                                                            
         l_returnflag STRING,                                                                                                     
         l_linestatus STRING,                                                                                                     
         l_commitdate STRING,                                                                                                     
         l_receiptdate STRING,                                                                                                    
         l_shipinstruct STRING,                                                                                                   
         l_shipmode STRING,                                                                                                       
         l_comment STRING                                                                                                         
       )                                                                                                                          
       PARTITIONED BY (                                                                                                           
         l_shipdate STRING,                                                                                                       
         l_orderkey_mod_100 BIGINT                                                                                                
       )                                                                                                                          
       STORED AS PARQUET                                                                        
      

      Source table

       CREATE TABLE scan_primitives_tpch_3tb.lineitem_partitioned (                                                          
         l_orderkey BIGINT,                                                                                                  
         l_partkey BIGINT,                                                                                                   
         l_suppkey BIGINT,                                                                                                   
         l_linenumber BIGINT,                                                                                                
         l_quantity DOUBLE,                                                                                                  
         l_extendedprice DOUBLE,                                                                                             
         l_discount DOUBLE,                                                                                                  
         l_tax DOUBLE,                                                                                                       
         l_returnflag STRING,                                                                                                
         l_linestatus STRING,                                                                                                
         l_commitdate STRING,                                                                                                
         l_receiptdate STRING,                                                                                               
         l_shipinstruct STRING,                                                                                              
         l_shipmode STRING,                                                                                                  
         l_comment STRING                                                                                                    
       )                                                                                                                     
       PARTITIONED BY (                                                                                                      
         l_shipdate STRING                                                                                                   
       )                                                                                                                     
       STORED AS PARQUET
      

      Exception

      I0505 09:16:00.523258 30661 jni-util.cc:176] java.lang.IllegalStateException
      	at com.google.common.base.Preconditions.checkState(Preconditions.java:129)
      	at org.apache.impala.planner.PipelinedPlanNodeSet.computePerHostResources(PipelinedPlanNodeSet.java:126)
      	at org.apache.impala.planner.Planner.computeResourceReqs(Planner.java:369)
      	at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1018)
      	at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1100)
      	at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:155)
      I0505 09:16:00.535969 30661 status.cc:119] IllegalStateException: null
          @           0x838a89  impala::Status::Status()
          @           0xb86880  impala::JniUtil::GetJniExceptionMsg()
          @           0xa984ab  impala::Frontend::GetExecRequest()
          @           0xab352d  impala::ImpalaServer::ExecuteInternal()
          @           0xab95a8  impala::ImpalaServer::Execute()
          @           0xaf5496  impala::ImpalaServer::query()
          @           0xd562e5  beeswax::BeeswaxServiceProcessor::process_query()
          @           0xd595e4  beeswax::BeeswaxServiceProcessor::dispatchCall()
          @           0x809b8c  apache::thrift::TDispatchProcessor::process()
          @          0x1b4464b  apache::thrift::server::TThreadPoolServer::Task::run()
          @          0x1b2c209  apache::thrift::concurrency::ThreadManager::Worker::run()
          @           0x9f8b19  impala::ThriftThread::RunRunnable()
          @           0x9f9572  boost::detail::function::void_function_obj_invoker0<>::invoke()
          @           0xbdd739  impala::Thread::SuperviseThread()
          @           0xbde184  boost::detail::thread_data<>::run()
          @           0xe4f3ba  (unknown)
          @       0x3797407aa1  (unknown)
          @       0x37970e893d  (unknown)
      I0505 09:16:00.537178 30661 impala-server.cc:921] UnregisterQuery(): query_id=7f4afbecf6752cdc:4531239000000000
      I0505 09:16:00.540961 30661 impala-server.cc:1009] Cancel(): query_id=7f4afbecf6752cdc:4531239000000000
      

        Attachments

          Activity

            People

            • Assignee:
              alex.behm Alexander Behm
              Reporter:
              mmokhtar Mostafa Mokhtar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: