Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-912

TestMiniMRWithDFS fails sporadically

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.1
    • Fix Version/s: 0.11.0
    • Component/s: None
    • Labels:
      None

      Description

      TestMiniMRWithDFS fails sporadically with the following error:

      junit.framework.AssertionFailedError: Spurious directory task_0001_m_000008_0 found in C:\hudson\workspace\Hadoop-WindowsSmokeTest\trunk\build\test\mapred\local\50068_0
      at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:128)
      at org.apache.hadoop.mapred.TestMiniMRWithDFS.testWithDFS(TestMiniMRWithDFS.java:163)

      This tests checks that all mapred.local.dirs have been cleaned up after running a mapred job on MiniMRCluster. Effectively, this tests waits for TaskTracker.isIdle() to return true before checking the dirs have been cleaned up. I believe that HADOOP-639 reordered the cleanup code so that isIdle() will return true before the directory cleanup is complete.

        Attachments

        1. HADOOP-912_20070122.patch
          0.5 kB
          Arun Murthy

          Activity

            People

            • Assignee:
              acmurthy Arun Murthy
              Reporter:
              nidaley Nigel Daley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: