[HADOOP-912] TestMiniMRWithDFS fails sporadically

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1
• Fix Version/s: 0.11.0
• Assignee: Arun Murthy
• Reporter: Nigel Daley
• Created: 20/Jan/07 01:23
• Updated: 08/Jul/09 16:52
• Resolved: 23/Jan/07 21:37

Description

TestMiniMRWithDFS fails sporadically with the following error:

junit.framework.AssertionFailedError: Spurious directory task_0001_m_000008_0 found in C:\hudson\workspace\Hadoop-WindowsSmokeTest\trunk\build\test\mapred\local\50068_0
at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:128)
at org.apache.hadoop.mapred.TestMiniMRWithDFS.testWithDFS(TestMiniMRWithDFS.java:163)

This tests checks that all mapred.local.dirs have been cleaned up after running a mapred job on MiniMRCluster. Effectively, this tests waits for TaskTracker.isIdle() to return true before checking the dirs have been cleaned up. I believe that HADOOP-639 reordered the cleanup code so that isIdle() will return true before the directory cleanup is complete.