[HADOOP-5114] A bunch of mapred unit tests are failing on Windows

• Type: Test
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.18.3
• Fix Version/s: 0.18.4
• Component/s: test

Environment

Windows

• Hadoop Flags: Reviewed
• Release Note: Remove timeout for accept() in DataNode. This made accept() fail in JDK on Windows and caused many tests to fail.
• Assignee: Raghu Angadi
• Reporter: Ramya Sunil
• Created: 23/Jan/09 08:08
• Updated: 08/Jul/09 16:53
• Resolved: 06/Feb/09 20:31

Description

A bunch of unit tests are consistently failing when run on Windows. Below are a list of unit tests which are failing and the corresponding exceptions thrown:

Exception: "java.net.ConnectException: Connection refused: no further information"
Failing tests:

• TestMiniMRMapRedDebugScript - testMapDebugScript
• TestNoDefaultsJobConf - testNoDefaults
• TestQueueManager - testAllEnabledACLForJobSubmission
• TestCompressedEmptyMapOutputs - testMapReduceSortWithCompressedEmptyMapOutputs
• TestJobInProgressListener - testJobQueueChanges
• TestKillCompletedJob - testKillCompJob
• TestMiniMRClasspath - testClassPath
• TestMiniMRDFSCaching - testWithDFS
• TestMiniMRWithDFSWithDistinctUsers - testDistinctUsers
• TestSetupAndCleanupFailure - testWithDFS
• TestDBJob - testRun
• TestMiniMRWithDFS - testWithDFS
• TestJobStatusPersistency - testNonPersistency
• TestSpecialCharactersInOutputPath - testJobWithDFS
• TestUserDefinedCounters - testMapReduceJob
• TestDelegatingInputFormat - testSplitting
• TestEmptyJobWithDFS - testEmptyJobWithDFS
• TestJavaSerialization - testMapReduceJob
• TestClusterMapReduceTestCase - testMapReduce

Exception: java.lang.IllegalArgumentException: Pathname /<path> from <path> is not a valid DFS filename.
Failing tests:

• TestJobInProgress - testRunningTaskCount
• TestJobQueueInformation - testJobQueues
• TestJobTrackerRestart - testJobTrackerRestart

Exception: java.io.IOException: Bad connect ack with firstBadLink 127.0.0.1:<port number>
Failing tests:

• TestJobSysDirWithDFS - testWithDFS
• TestJobInProgress - testPendingMapTaskCount
• TestMiniMRDFSSort - testMapReduceSort

Exception: junit.framework.AssertionFailedError
Failing tests:

• TestMRServerPorts - testJobTrackerPorts
• TestMRServerPorts - testTaskTrackerPorts
• TestMiniMRTaskTempDir - testTaskTempDir

Exception: java.io.IOException: Job failed!
Failing tests:

• TestMiniMRLocalFS - testWithLocal

Issue Links

• is related to: HADOOP-4679 Datanode prints tons of log messages: Waiting for threadgroup to exit, active theads is XX
• is related to: HDFS-405 Several unit tests failing on Windows frequently
• relates to: HDFS-11 Tests fail on windows due to BindException.