[MAPREDUCE-3186] User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.23.0
• Fix Version/s: 0.23.0
• Component/s: mrv2
• Labels: test

Environment

linux

• Target Version/s: 0.23.0
• Hadoop Flags: Reviewed

Release Note

New Yarn configuration property:

Name: yarn.app.mapreduce.am.scheduler.connection.retries
Description: Number of times AM should retry to contact RM if connection is lost.

• Assignee: Eric Payne
• Reporter: Ramgopal N
• Created: 14/Oct/11 08:59
• Updated: 25/Jul/18 10:35
• Resolved: 28/Oct/11 01:42

Description

If the resource manager is restarted while the job execution is in progress, the job is getting hanged.
UI shows the job as running.
In the RM log, it is throwing an error "ERROR org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: AppAttemptId doesnt exist in cache appattempt_1318579738195_0004_000001"
In the console MRAppMaster and Runjar processes are not getting killed

Issue Links

• is cloned by: MAPREDUCE-3286 Unit tests for MAPREDUCE-3186 - User jobs are getting hanged if the Resource manager process goes down and comes up while job is getting executed.