[HDFS-6715] webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.6.0
• Component/s: ha, webhdfs
• Hadoop Flags: Reviewed
• Assignee: Jing Zhao
• Reporter: Arpit Gupta
• Created: 21/Jul/14 21:26
• Updated: 01/Dec/14 03:09
• Resolved: 24/Jul/14 18:31

Description

Noticed in our HA testing when we run MR job with webhdfs file system we some times run into

2014-04-17 05:08:06,346 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1397710493213_0001_r_000008_0: Container killed by the ApplicationMaster.
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143

2014-04-17 05:08:10,205 ERROR [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Could not commit job
java.io.IOException: Namenode is in startup mode
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)