Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1546

TestMapReduceActionExecutorUberJar.testMapReduceWithUberJarEnabled fails

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: trunk, 4.0.0
    • Fix Version/s: 4.1.0
    • Component/s: tests
    • Labels:
      None

      Description

      org.apache.oozie.action.hadoop.TestMapReduceActionExecutorUberJar.testMapReduceWithUberJarEnabled fails because OOZIE-1501 added a check that the Hadoop counter "MAP_OUTPUT_RECORDS" is 2. In the non-UberJar version of the test, this is 2 because the map outputs the 2 dummy inputs. In the UberJar version, we check what's in the classpath by outputting it from the map task as separate records; this means that the "MAP_OUTPUT_RECORDS" can vary depending on what's in the classpath.

      This wasn't caught by Jenkins because this test is normally skipped because the Uber Jar feature doesn't work with the current versions of Hadoop that we're using.

        Attachments

        1. OOZIE-1546.patch
          4 kB
          Robert Kanter
        2. OOZIE-1546.patch
          4 kB
          Robert Kanter

          Issue Links

            Activity

              People

              • Assignee:
                rkanter Robert Kanter
                Reporter:
                rkanter Robert Kanter
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: