Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19142 Umbrella: branch-3 failing tests
  3. HIVE-19347

TestTriggersWorkloadManager tests are failing consistently

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 3.1.0, 3.0.0
    • None
    • None

    Description

      Caused by the patch which turned on vectorization. Following tests are failing due to the patch:

      • org.apache.hive.jdbc.TestJdbcDriver2.testResultSetMetaData
      • org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1]
      • org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[explainuser_1]
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesWrite 10 sec 14
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomReadOps 7.7 sec 14
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedFiles 15 sec 14
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers2 17 sec 14
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryExecutionTime 1.5 sec 14
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryElapsedTime
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerVertexRawInputSplitsNoKill 20 sec 18
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighShuffleBytes 1.4 sec 18
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomNonExistent 2.6 sec 18
      • org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesRead
      Error Message
      Expected query to succeed expected null, but was:<java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 3, vertexId=vertex_1524884047358_0001_21_01, diagnostics=[Task failed, taskId=task_1524884047358_0001_21_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1524884047358_0001_21_01_000000_0:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.io.IOException: java.lang.NullPointerException
       at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
       at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
       at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
       at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
       at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
       at java.security.AccessController.doPrivileged(Native Method)
       at javax.security.auth.Subject.doAs(Subject.java:422)
       at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
       at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
       at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
       at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
       at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
       at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
       at java.lang.Thread.run(Thread.java:745)
      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.io.IOException: java.lang.NullPointerException
       at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:80)
       at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419)
       at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)
       ... 15 more
      

      Attachments

        1. HIVE-19347.01.patch
          2 kB
          Matt McCline
        2. HIVE-19347.02.patch
          2 kB
          Matt McCline

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mmccline Matt McCline Assign to me
            vgarg Vineet Garg
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment