[#HADOOP-5921] JobTracker does not come up because of NotReplicatedYetException

Hadoop Common

Created: 27/May/09 09:50 AM Updated: 08/Jul/09 04:53 PM

Return to search

Component/s:

None

Affects Version/s:

0.20.0

Fix Version/s:

0.20.1

Time Tracking:

Not Specified

File Attachments:

Hadoop Flags:	Reviewed
Release Note:	Jobtracker crashes if it fails to create jobtracker.info file (i.e if sufficient datanodes are not up). With this patch it keeps on retrying on IOExceptions assuming IOExceptions in jobtracker.info creation implies that the hdfs is not in ready state.
Resolution Date:	15/Jun/09 06:17 AM

Description

« Hide

Sometimes (On a big cluster) Jobtracker does not come up, because Info file could not be replicated on dfs.

All

Comments

Work Log

Change History

Subversion Commits

Sort Order:

Repository	Revision	Date	User	Message
ASF	#784661	Mon Jun 15 06:05:01 UTC 2009	ddas	~~HADOOP-5921~~. Fixes a problem in the JobTracker where it sometimes never used to come up due to a system file creation on JobTracker's system-dir failing.This problem would sometimes show up only when the FS for the system-dir (usually HDFS) is started at nearly the same time as the JobTracker. Contributed by Amar Kamat.
				Files Changed
				MODIFY /hadoop/core/trunk/CHANGES.txt MODIFY /hadoop/core/trunk/src/test/mapred/org/apache/hadoop/mapred/TestRecoveryManager.java MODIFY /hadoop/core/trunk/src/mapred/org/apache/hadoop/mapred/JobTracker.java

Repository	Revision	Date	User	Message
ASF	#784664	Mon Jun 15 06:16:59 UTC 2009	ddas	Merge -r 784660:784661 from trunk onto 0.20 branch. Had to apply the testcase part of the patch manually though since the patch was only for trunk. Fixes ~~HADOOP-5921~~.
				Files Changed
				MODIFY /hadoop/core/branches/branch-0.20/src/test/org/apache/hadoop/mapred/TestRecoveryManager.java MODIFY /hadoop/core/branches/branch-0.20/CHANGES.txt MODIFY /hadoop/core/branches/branch-0.20/src/mapred/org/apache/hadoop/mapred/JobTracker.java MODIFY /hadoop/core/branches/branch-0.20