[HIVE-19347] TestTriggersWorkloadManager tests are failing consistently

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.1.0, 3.0.0
• Target Version/s: 3.1.0, 3.0.0
• Assignee: Matt McCline
• Reporter: Vineet Garg
• Created: 28/Apr/18 21:05
• Updated: 22/May/18 23:14
• Resolved: 11/May/18 07:49

Description

Caused by the patch which turned on vectorization. Following tests are failing due to the patch:

• org.apache.hive.jdbc.TestJdbcDriver2.testResultSetMetaData
• org.apache.hadoop.hive.cli.TestMiniSparkOnYarnCliDriver.testCliDriver[spark_explainuser_1]
• org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[explainuser_1]
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesWrite 10 sec 14
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomReadOps 7.7 sec 14
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomCreatedFiles 15 sec 14
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testMultipleTriggers2 17 sec 14
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryExecutionTime 1.5 sec 14
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerSlowQueryElapsedTime
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerVertexRawInputSplitsNoKill 20 sec 18
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighShuffleBytes 1.4 sec 18
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerCustomNonExistent 2.6 sec 18
• org.apache.hive.jdbc.TestTriggersWorkloadManager.testTriggerHighBytesRead

Error Message
Expected query to succeed expected null, but was:<java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 3, vertexId=vertex_1524884047358_0001_21_01, diagnostics=[Task failed, taskId=task_1524884047358_0001_21_01_000000, diagnostics=[TaskAttempt 0 failed, info=[Error: Error while running task ( failure ) : attempt_1524884047358_0001_21_01_000000_0:java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.io.IOException: java.lang.NullPointerException
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:296)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250)
 at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374)
 at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
 at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:422)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1962)
 at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
 at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
 at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
 at org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
 at java.util.concurrent.FutureTask.run(FutureTask.java:266)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
 at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.io.IOException: java.io.IOException: java.lang.NullPointerException
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:80)
 at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:419)
 at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)
 ... 15 more