Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5598

TestUserDefinedCounters.testMapReduceJob is flakey

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 2.3.0
    • test
    • None
    • Reviewed

    Description

      TestUserDefinedCounters.testMapReduceJob is flakey.

      We sometimes see it fail:

      junit.framework.AssertionFailedError
      	at junit.framework.Assert.fail(Assert.java:48)
      	at junit.framework.Assert.assertTrue(Assert.java:20)
      	at junit.framework.Assert.assertTrue(Assert.java:27)
      	at org.apache.hadoop.mapred.TestUserDefinedCounters.testMapReduceJob(TestUserDefinedCounters.java:113)
      

      Upon investigation, the problem is that the input for the MR job in this test is at System.getProperty("test.build.data", "/tmp") + "/input". If an earlier test wrote some files there, this test will use them as part of its input. This can cause all sorts of problems with this test because its not expecting the additional input data.

      Attachments

        1. MAPREDUCE-5598.patch
          1 kB
          Robert Kanter
        2. MAPREDUCE-5598.patch
          1 kB
          Robert Kanter

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            rkanter Robert Kanter
            rkanter Robert Kanter
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment