Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-912

TestMiniMRWithDFS fails sporadically

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.1
    • 0.11.0
    • None
    • None

    Description

      TestMiniMRWithDFS fails sporadically with the following error:

      junit.framework.AssertionFailedError: Spurious directory task_0001_m_000008_0 found in C:\hudson\workspace\Hadoop-WindowsSmokeTest\trunk\build\test\mapred\local\50068_0
      at org.apache.hadoop.mapred.TestMiniMRWithDFS.checkTaskDirectories(TestMiniMRWithDFS.java:128)
      at org.apache.hadoop.mapred.TestMiniMRWithDFS.testWithDFS(TestMiniMRWithDFS.java:163)

      This tests checks that all mapred.local.dirs have been cleaned up after running a mapred job on MiniMRCluster. Effectively, this tests waits for TaskTracker.isIdle() to return true before checking the dirs have been cleaned up. I believe that HADOOP-639 reordered the cleanup code so that isIdle() will return true before the directory cleanup is complete.

      Attachments

        1. HADOOP-912_20070122.patch
          0.5 kB
          Arun Murthy

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            acmurthy Arun Murthy
            nidaley Nigel Daley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment