Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2344

Enabling 'oozie.action.jobinfo.enable' doesn't inject the job information into the map/reduce job's configuration.

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.3.0
    • Component/s: None
    • Labels:
      None

      Description

      According to OOZIE-1658, enabling 'oozie.action.jobinfo.enable' should inject a property, 'oozie.job.info', into the mapreduce job's configuration containing information of bundle, coordinator, workflow and actions. However, this doesn't seem to be the case.

      To fix this, I think we should make sure to inject this property before the actionConf is written to action.xml.

        Issue Links

          Activity

          Hide
          rkanter Robert Kanter added a comment -

          Closing issue; Oozie 4.3.0 is released.

          Show
          rkanter Robert Kanter added a comment - Closing issue; Oozie 4.3.0 is released.
          Hide
          akshayrai09 Akshay Rai added a comment -

          Thanks Robert Kanter.

          Show
          akshayrai09 Akshay Rai added a comment - Thanks Robert Kanter .
          Hide
          rkanter Robert Kanter added a comment -

          Fixing this for the Hive2 action requires a little extra work. I've created OOZIE-2355 to do that.

          Show
          rkanter Robert Kanter added a comment - Fixing this for the Hive2 action requires a little extra work. I've created OOZIE-2355 to do that.
          Hide
          rkanter Robert Kanter added a comment -

          Thanks Akshay Rai. Committed to trunk!

          Show
          rkanter Robert Kanter added a comment - Thanks Akshay Rai . Committed to trunk!
          Hide
          rkanter Robert Kanter added a comment - - edited

          +1 LGTM
          This also affects other action types.

          Jenkins has been acting up lately. The change is minimal and I ran a bunch of the ActionExecutor and Main tests locally.

          Show
          rkanter Robert Kanter added a comment - - edited +1 LGTM This also affects other action types. Jenkins has been acting up lately. The change is minimal and I ran a bunch of the ActionExecutor and Main tests locally.
          Hide
          hadoopqa Hadoop QA added a comment -

          Testing JIRA OOZIE-2344

          Cleaning local git workspace

          ----------------------------

          +1 PATCH_APPLIES
          +1 CLEAN
          -1 RAW_PATCH_ANALYSIS
          . +1 the patch does not introduce any @author tags
          . +1 the patch does not introduce any tabs
          . +1 the patch does not introduce any trailing spaces
          . +1 the patch does not introduce any line longer than 132
          . -1 the patch does not add/modify any testcase
          +1 RAT
          . +1 the patch does not seem to introduce new RAT warnings
          +1 JAVADOC
          . +1 the patch does not seem to introduce new Javadoc warnings
          +1 COMPILE
          . +1 HEAD compiles
          . +1 patch compiles
          . +1 the patch does not seem to introduce new javac warnings
          +1 BACKWARDS_COMPATIBILITY
          . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
          . +1 the patch does not modify JPA files
          -1 TESTS - patch does not compile, cannot run testcases
          +1 DISTRO
          . +1 distro tarball builds with the patch

          ----------------------------
          -1 Overall result, please check the reported -1(s)

          The full output of the test-patch run is available at

          . https://builds.apache.org/job/oozie-trunk-precommit-build/2532/

          Show
          hadoopqa Hadoop QA added a comment - Testing JIRA OOZIE-2344 Cleaning local git workspace ---------------------------- +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS . +1 the patch does not introduce any @author tags . +1 the patch does not introduce any tabs . +1 the patch does not introduce any trailing spaces . +1 the patch does not introduce any line longer than 132 . -1 the patch does not add/modify any testcase +1 RAT . +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC . +1 the patch does not seem to introduce new Javadoc warnings +1 COMPILE . +1 HEAD compiles . +1 patch compiles . +1 the patch does not seem to introduce new javac warnings +1 BACKWARDS_COMPATIBILITY . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations . +1 the patch does not modify JPA files -1 TESTS - patch does not compile, cannot run testcases +1 DISTRO . +1 distro tarball builds with the patch ---------------------------- -1 Overall result, please check the reported -1(s) The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2532/
          Hide
          akshayrai09 Akshay Rai added a comment -

          Purshotam Shah, could you review the fix. The test failures are not related.

          I tried to re-trigger the test-patch by cancelling and submitting it but it still hasn't run.

          Doesn't "cancel patch + submit patch" re-trigger the test-patch build without re-uploading the patch?

          Show
          akshayrai09 Akshay Rai added a comment - Purshotam Shah , could you review the fix. The test failures are not related. I tried to re-trigger the test-patch by cancelling and submitting it but it still hasn't run. Doesn't "cancel patch + submit patch" re-trigger the test-patch build without re-uploading the patch?
          Hide
          akshayrai09 Akshay Rai added a comment -

          Retriggering a test-patch build.

          Show
          akshayrai09 Akshay Rai added a comment - Retriggering a test-patch build.
          Hide
          hadoopqa Hadoop QA added a comment -

          Testing JIRA OOZIE-2344

          Cleaning local git workspace

          ----------------------------

          +1 PATCH_APPLIES
          +1 CLEAN
          -1 RAW_PATCH_ANALYSIS
          . +1 the patch does not introduce any @author tags
          . +1 the patch does not introduce any tabs
          . +1 the patch does not introduce any trailing spaces
          . +1 the patch does not introduce any line longer than 132
          . -1 the patch does not add/modify any testcase
          +1 RAT
          . +1 the patch does not seem to introduce new RAT warnings
          +1 JAVADOC
          . +1 the patch does not seem to introduce new Javadoc warnings
          +1 COMPILE
          . +1 HEAD compiles
          . +1 patch compiles
          . +1 the patch does not seem to introduce new javac warnings
          +1 BACKWARDS_COMPATIBILITY
          . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
          . +1 the patch does not modify JPA files
          -1 TESTS
          . Tests run: 1690
          . Tests failed: 8
          . Tests errors: 7

          . The patch failed the following testcases:

          . testRerunFork(org.apache.oozie.command.wf.TestReRunXCommand)
          . testWorkflowActionRecoveryUserRetry(org.apache.oozie.service.TestRecoveryService)
          . testWorkflowActionEvent(org.apache.oozie.event.TestEventGeneration)
          . testCoordMaterializeTriggerService3(org.apache.oozie.service.TestCoordMaterializeTriggerService)
          . testMessage_withMixedStatus(org.apache.oozie.command.coord.TestAbandonedCoordChecker)
          . testActionWithEscapedStringAndCDATA(org.apache.oozie.command.wf.TestActionStartXCommand)
          . testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand)
          . testActionReuseWfJobAppPath(org.apache.oozie.command.wf.TestActionStartXCommand)

          +1 DISTRO
          . +1 distro tarball builds with the patch

          ----------------------------
          -1 Overall result, please check the reported -1(s)

          The full output of the test-patch run is available at

          . https://builds.apache.org/job/oozie-trunk-precommit-build/2526/

          Show
          hadoopqa Hadoop QA added a comment - Testing JIRA OOZIE-2344 Cleaning local git workspace ---------------------------- +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS . +1 the patch does not introduce any @author tags . +1 the patch does not introduce any tabs . +1 the patch does not introduce any trailing spaces . +1 the patch does not introduce any line longer than 132 . -1 the patch does not add/modify any testcase +1 RAT . +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC . +1 the patch does not seem to introduce new Javadoc warnings +1 COMPILE . +1 HEAD compiles . +1 patch compiles . +1 the patch does not seem to introduce new javac warnings +1 BACKWARDS_COMPATIBILITY . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations . +1 the patch does not modify JPA files -1 TESTS . Tests run: 1690 . Tests failed: 8 . Tests errors: 7 . The patch failed the following testcases: . testRerunFork(org.apache.oozie.command.wf.TestReRunXCommand) . testWorkflowActionRecoveryUserRetry(org.apache.oozie.service.TestRecoveryService) . testWorkflowActionEvent(org.apache.oozie.event.TestEventGeneration) . testCoordMaterializeTriggerService3(org.apache.oozie.service.TestCoordMaterializeTriggerService) . testMessage_withMixedStatus(org.apache.oozie.command.coord.TestAbandonedCoordChecker) . testActionWithEscapedStringAndCDATA(org.apache.oozie.command.wf.TestActionStartXCommand) . testActionStart(org.apache.oozie.command.wf.TestActionStartXCommand) . testActionReuseWfJobAppPath(org.apache.oozie.command.wf.TestActionStartXCommand) +1 DISTRO . +1 distro tarball builds with the patch ---------------------------- -1 Overall result, please check the reported -1(s) The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2526/
          Hide
          hadoopqa Hadoop QA added a comment -

          Testing JIRA OOZIE-2344

          Cleaning local git workspace

          ----------------------------

          -1 Patch failed to apply to head of branch

          ----------------------------

          Show
          hadoopqa Hadoop QA added a comment - Testing JIRA OOZIE-2344 Cleaning local git workspace ---------------------------- -1 Patch failed to apply to head of branch ----------------------------
          Hide
          akshayrai09 Akshay Rai added a comment -

          Made changes to inject oozie job info before the actionConf is written to action.xml

          Show
          akshayrai09 Akshay Rai added a comment - Made changes to inject oozie job info before the actionConf is written to action.xml

            People

            • Assignee:
              akshayrai09 Akshay Rai
              Reporter:
              akshayrai09 Akshay Rai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development