Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10344

Error loading functional_orc_def.alltypesaggmultifiles in hive

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: Impala 4.0.0
    • Fix Version/s: None
    • Component/s: Infrastructure

      Description

      Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles

      0: jdbc:hive2://localhost:11050/default> insert into table functional_orc_def.al 
      ltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_co 
      l, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, st 
      ring_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles  
      where id % 4 = 1;
      going to print operations logs
      printed operations logs
      going to print operations logs
      INFO  : Compiling command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9): insert into table functional_orc_def.alltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles where id % 4 = 1
      INFO  : No Stats for functional@alltypesaggmultifiles, Columns: float_col, int_col, string_col, bool_col, date_string_col, smallint_col, timestamp_col, tinyint_col, bigint_col, id, double_col
      INFO  : Semantic Analysis Completed (retrial = false)
      INFO  : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:id, type:int, comment:null), FieldSchema(name:bool_col, type:boolean, comment:null), FieldSchema(name:tinyint_col, type:tinyint, comment:null), FieldSchema(name:smallint_col, type:smallint, comment:null), FieldSchema(name:int_col, type:int, comment:null), FieldSchema(name:bigint_col, type:bigint, comment:null), FieldSchema(name:float_col, type:float, comment:null), FieldSchema(name:double_col, type:double, comment:null), FieldSchema(name:date_string_col, type:string, comment:null), FieldSchema(name:string_col, type:string, comment:null), FieldSchema(name:timestamp_col, type:timestamp, comment:null), FieldSchema(name:year, type:int, comment:null), FieldSchema(name:month, type:int, comment:null), FieldSchema(name:day, type:int, comment:null)], properties:null)
      INFO  : Completed compiling command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9); Time taken: 0.036 seconds
      INFO  : Executing command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9): insert into table functional_orc_def.alltypesaggmultifiles partition (year, month, day) SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col, timestamp_col, year, month, day FROM functional.alltypesaggmultifiles where id % 4 = 1
      INFO  : Query ID = jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9
      INFO  : Total jobs = 1
      INFO  : Launching Job 1 out of 1
      INFO  : Starting task [Stage-1:MAPRED] in serial mode
      INFO  : Subscribed to counters: [] for queryId: jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9
      INFO  : Session is already open
      INFO  : Dag name: insert into table functional_orc_def.all...1 (Stage-1)
      INFO  : Status: Running (Executing on YARN cluster with App id application_1605304119768_0012)
      
      printed operations logs
      ----------------------------------------------------------------------------------------------
              VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
      ----------------------------------------------------------------------------------------------
      Map 1 .......... container     SUCCEEDED     42         42        0        0       0       0  
      Reducer 2        container       RUNNING      1          0        1        0       0       0  
      ----------------------------------------------------------------------------------------------
      VERTICES: 01/02  [=========================>>-] 97%   ELAPSED TIME: 1.46 s     
      ----------------------------------------------------------------------------------------------
      ----------------------------------------------------------------------------------------------
              VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
      ----------------------------------------------------------------------------------------------
      Map 1 .......... container     SUCCEEDED     42         42        0        0       0       0  
      Reducer 2        container       RUNNING      1          0        1        0       0       0  
      ----------------------------------------------------------------------------------------------
      VERTICES: 01/02  [=========================>>-] 97%   ELAPSED TIME: 1.96 s     
      ----------------------------------------------------------------------------------------------
      ----------------------------------------------------------------------------------------------
              VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
      ----------------------------------------------------------------------------------------------
      Map 1 .......... container     SUCCEEDED     42         42        0        0       0       0  
      Reducer 2 ...... container     SUCCEEDED      1          1        0        0       1       0  
      ----------------------------------------------------------------------------------------------
      VERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.46 s     
      ----------------------------------------------------------------------------------------------
      ----------------------------------------------------------------------------------------------
              VERTICES      MODE        STATUS  TOTAL  COMPLETED  RUNNING  PENDING  FAILED  KILLED  
      ----------------------------------------------------------------------------------------------
      Map 1 .......... container     SUCCEEDED     42         42        0        0       0       0  
      Reducer 2 ...... container     SUCCEEDED      1          1        0        0       1       0  
      ----------------------------------------------------------------------------------------------
      VERTICES: 02/02  [==========================>>] 100%  ELAPSED TIME: 2.49 s     
      ----------------------------------------------------------------------------------------------
      Getting log thread is interrupted, since query is done!
      INFO  : Starting task [Stage-2:DEPENDENCY_COLLECTION] in serial mode
      INFO  : Starting task [Stage-0:MOVE] in serial mode
      INFO  : Loading data to table functional_orc_def.alltypesaggmultifiles partition (year=null, month=null, day=null) from hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
      INFO  : 
      
      ERROR : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
      INFO  : Completed executing command(queryId=jenkins_20201113135913_d2ecc422-ec51-4fe2-9e92-e8d93b01aca9); Time taken: 2.511 seconds
      INFO  : OK
      Error: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def (state=08S01,code=1)
      java.sql.SQLException: Error while compiling statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask. Exception when loading 11 partitions in table alltypesaggmultifiles with loadPath=hdfs://localhost:20500/test-warehouse/managed/alltypesaggmultifiles_orc_def
      	at org.apache.hive.jdbc.HiveStatement.waitForOperationToComplete(HiveStatement.java:401)
      	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:266)
      	at org.apache.hive.beeline.Commands.executeInternal(Commands.java:1007)
      	at org.apache.hive.beeline.Commands.execute(Commands.java:1217)
      	at org.apache.hive.beeline.Commands.sql(Commands.java:1146)
      	at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1497)
      	at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:1355)
      	at org.apache.hive.beeline.BeeLine.executeFile(BeeLine.java:1329)
      	at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1127)
      	at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1082)
      	at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:546)
      	at org.apache.hive.beeline.BeeLine.main(BeeLine.java:528)
      	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      	at java.lang.reflect.Method.invoke(Method.java:498)
      	at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
      	at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
      Closing: 0: jdbc:hive2://localhost:11050/default;auth=none
      

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tarmstrong Tim Armstrong

              Dates

              • Created:
                Updated:

                Issue deployment