[MAPREDUCE-5355] MiniMRYarnCluster with localFs does not work on Windows

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.1.0-beta, 3.0.0-alpha1
• Fix Version/s: 2.1.0-beta
• Target Version/s: 2.1.0-beta
• Hadoop Flags: Reviewed
• Assignee: Chuan Liu
• Reporter: Chuan Liu
• Created: 27/Jun/13 16:48
• Updated: 12/May/16 18:22
• Resolved: 02/Jul/13 23:40

Description

When MiniMRYarnCluster configured to run on localFs instead of remoteFs, i.e. MiniDFSCluster, the job will fail on Windows. The error message looks like the following.

java.io.IOException: Job status not available

In my testing, the following unit tests hit this exception.

• TestMRJobsWithHistoryService
• TestClusterMRNotification
• TestJobCleanup
• TestJobCounters
• TestMiniMRClientCluster
• TestJobOutputCommitter
• TestMRAppWithCombiner
• TestMROldApiJobs
• TestSpeculativeExecution

Issue Links

• is part of: MAPREDUCE-4401 Enhancements to MapReduce for Windows Server and Windows Azure development and runtime environments