[MAPREDUCE-3514] JHS failed to start when intermediate done path is in LocalFS

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0-alpha
• Component/s: jobhistoryserver, mrv2

Environment

Single Node Cluster

• Assignee: Unassigned
• Reporter: Bhallamudi Venkata Siva Kamesh
• Created: 06/Dec/11 12:08
• Updated: 10/Mar/15 04:32

Description

This is the property I have set for intermediate done directory

<property>
 <name>mapreduce.jobhistory.intermediate-done-dir</name>
 <value>file:///mnt/history/done_intermediate</value>
</property>

After setting this property, When I started the JHS, it failed to start, and was throwing following exception

2011-12-06 12:09:13,650 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
org.apache.hadoop.fs.InvalidPathException: Invalid path name Wrong FS: file://<NN Address>:<NN Port>/mnt/history/done_intermediate, expected: file:///
	at org.apache.hadoop.fs.AbstractFileSystem.checkPath(AbstractFileSystem.java:361)
	at org.apache.hadoop.fs.FilterFs.checkPath(FilterFs.java:161)
	at org.apache.hadoop.fs.FilterFs.getFileStatus(FilterFs.java:115)
	at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1086)
	at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1083)
	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
	at org.apache.hadoop.fs.FileContext.getFileStatus(FileContext.java:1083)
	at org.apache.hadoop.fs.FileContext$Util.exists(FileContext.java:1506)
	at org.apache.hadoop.mapreduce.v2.hs.JobHistory.mkdir(JobHistory.java:232)
	at org.apache.hadoop.mapreduce.v2.hs.JobHistory.init(JobHistory.java:201)
	at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
	at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.init(JobHistoryServer.java:62)
	at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:77)
2011-12-06 12:09:13,653 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG: