Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1546

TestMapReduceActionExecutorUberJar.testMapReduceWithUberJarEnabled fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • trunk, 4.0.0
    • 4.1.0
    • tests
    • None

    Description

      org.apache.oozie.action.hadoop.TestMapReduceActionExecutorUberJar.testMapReduceWithUberJarEnabled fails because OOZIE-1501 added a check that the Hadoop counter "MAP_OUTPUT_RECORDS" is 2. In the non-UberJar version of the test, this is 2 because the map outputs the 2 dummy inputs. In the UberJar version, we check what's in the classpath by outputting it from the map task as separate records; this means that the "MAP_OUTPUT_RECORDS" can vary depending on what's in the classpath.

      This wasn't caught by Jenkins because this test is normally skipped because the Uber Jar feature doesn't work with the current versions of Hadoop that we're using.

      Attachments

        1. OOZIE-1546.patch
          4 kB
          Robert Kanter
        2. OOZIE-1546.patch
          4 kB
          Robert Kanter

        Issue Links

          Activity

            People

              rkanter Robert Kanter
              rkanter Robert Kanter
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: