[TEZ-3096] Statemachine: TA_TEZ_EVENT_UPDATE at KILL_IN_PROGRESS fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Unassigned
• Reporter: Gopal Vijayaraghavan
• Created: 04/Feb/16 05:08
• Updated: 24/Mar/16 04:53
• Resolved: 08/Mar/16 22:39

Description

Tasks are failing exactly 300ms into running due to a FileSystem error.

2016-02-04 05:05:56,853 [ERROR] [Dispatcher thread {Central}] |impl.TaskAttemptImpl|: Can't handle this event at current state for attempt_1454544113740_0027_1_00_000003_3
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: TA_TEZ_EVENT_UPDATE at KILL_IN_PROGRESS
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
        at org.apache.tez.dag.app.dag.impl.TaskAttemptImpl.handle(TaskAttemptImpl.java:795)
        at org.apache.tez.dag.app.dag.impl.TaskAttemptImpl.handle(TaskAttemptImpl.java:120)
        at org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher.handle(DAGAppMaster.java:2180)
        at org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher.handle(DAGAppMaster.java:2165)
        at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
        at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
        at java.lang.Thread.run(Thread.java:745)
2016-02-04 05:05:56,903 [ERROR] [Dispatcher thread {Central}] |impl.TaskAttemptImpl|: Can't handle this event at current state for attempt_1454544113740_0027_1_00_000000_3
org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: TA_TEZ_EVENT_UPDATE at KILL_IN_PROGRESS
        at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
        at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
        at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
        at org.apache.tez.dag.app.dag.impl.TaskAttemptImpl.handle(TaskAttemptImpl.java:795)
        at org.apache.tez.dag.app.dag.impl.TaskAttemptImpl.handle(TaskAttemptImpl.java:120)
        at org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher.handle(DAGAppMaster.java:2180)
        at org.apache.tez.dag.app.DAGAppMaster$TaskAttemptEventDispatcher.handle(DAGAppMaster.java:2165)
        at org.apache.tez.common.AsyncDispatcher.dispatch(AsyncDispatcher.java:183)
        at org.apache.tez.common.AsyncDispatcher$1.run(AsyncDispatcher.java:114)
        at java.lang.Thread.run(Thread.java:745)

Issue Links

• duplicates: TEZ-3148 Invalid event TA_TEZ_EVENT_UPDATE on TaskAttempt
• is duplicated by: TEZ-3186 teztask event problem when running repeated queries on LLAP