[HIVE-10766] LLAP: Exception reported while trying to kill a task

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: llap
• Assignee: Prasanth Jayachandran
• Reporter: Siddharth Seth
• Created: 20/May/15 05:33
• Updated: 18/Nov/15 20:05

Description

2015-05-19 22:23:01,759 [TezTaskRunner_attempt_1432098888221_0002_1_02_000000_0(container_222212222_0002_01_000013_sseth_20150519222213_595b6e19-4404-4d6d-8d3c-84521b26d5f2:2_Reducer 3_0_0)] ERROR org.apache.hadoop.hive.ql.exec.tez.TezProcessor: java.lang.InterruptedException
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
  at org.apache.tez.runtime.InputReadyTracker$InputReadyMonitor.awaitCondition(InputReadyTracker.java:120)
  at org.apache.tez.runtime.InputReadyTracker.waitForAllInputsReady(InputReadyTracker.java:90)
  at org.apache.tez.runtime.api.impl.TezProcessorContextImpl.waitForAllInputsReady(TezProcessorContextImpl.java:116)
  at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.init(ReduceRecordProcessor.java:124)
  at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:147)
  at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:137)
  at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:346)
  at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:71)
  at org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:60)
  at java.security.AccessController.doPrivileged(Native Method)
  at javax.security.auth.Subject.doAs(Subject.java:415)
  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
  at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:60)
  at org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:35)
  at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
  at java.util.concurrent.FutureTask.run(FutureTask.java:262)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:745)

Couple of other bits.
The abort boolean flag in the ReduceRecordProcessor has thread visibility issues. Making it volatile should be sufficient.

What's the expected behaviour from the Hive Processor when it's killed ?