Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
1-win
-
None
-
Reviewed
Description
JobTracker today expects the system directory to be in the default file system
if (fs == null) {
fs = mrOwner.doAs(new PrivilegedExceptionAction<FileSystem>() {
public FileSystem run() throws IOException {
return FileSystem.get(conf);
}});
}
...
public String getSystemDir()
{ Path sysDir = new Path(conf.get("mapred.system.dir", "/tmp/hadoop/mapred/system")); return fs.makeQualified(sysDir).toString(); }In Cloud like Azure the default file system is set as ASV (Windows Azure Blob Storage), but we would still like the system directory to be in DFS. We should change JobTracker to allow that.
Attachments
Attachments
Issue Links
- is part of
-
HADOOP-8645 Stabilize branch-1-win
- Resolved
- relates to
-
MAPREDUCE-5277 Job history completed location cannot be on a file system other than default
- Resolved