[HADOOP-9687] branch-1-win TestJobTrackerQuiescence and TestFileLengthOnClusterRestart failed caused by incorrect DFS path construction on Windows

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1-win
• Fix Version/s: 1-win
• Component/s: test

Environment

Windows

• Target Version/s: 1-win
• Hadoop Flags: Reviewed
• Assignee: Douma Fang
• Reporter: Douma Fang
• Created: 02/Jul/13 23:00
• Updated: 05/Jul/13 22:10
• Resolved: 04/Jul/13 16:09

Description

TestJobTrackerQuiescence is a test case introduced in https://issues.apache.org/jira/browse/MAPREDUCE-4328.
Here is the code generating a file path on DFS:

 final Path testDir = 
    new Path(System.getProperty("test.build.data", "/tmp"), "jt-safemode");

This doesn't work on Windows because "test.build.data" would have a driver name with ":" (e.g. D:/hadoop/build/test). However, this is not a valid path name on DFS because colon is disallowed (See DFSUtil#isValidName()).

A similar problem happens to TestFileLengthOnClusterRestart#testFileLengthWithHSyncAndClusterRestartWithOutDNsRegister()

  Path path = new Path(MiniDFSCluster.getBaseDir().getPath(), "test");

Issue Links

• is part of: HADOOP-8562 Enhancements to support Hadoop on Windows Server and Windows Azure environments