Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2355

Hive2 Action doesn't pass along oozie configs to jobconf

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.1.0
    • Fix Version/s: 4.3.0
    • Component/s: None
    • Labels:
      None

      Description

      We're currently only passing along the MR yarn tags property to the child job in the Hive2 action. We do this via the --hiveconf CLI argument, so it has to be explicitly done, unlike most other action types. We should also do this for any oozie.* properties other than oozie.launcher.* ones. This way, properties such as oozie.job.id and oozie.job.info will be correctly set in the child jobs launched by Hive Server 2.

        Issue Links

          Activity

          Hide
          rkanter Robert Kanter added a comment -

          The patch passes the configs via --hiveconf as described above. I also made a minor change to the hive2 example so that it is runnable without having to manually delete the table, just like the regular hive example.

          Show
          rkanter Robert Kanter added a comment - The patch passes the configs via --hiveconf as described above. I also made a minor change to the hive2 example so that it is runnable without having to manually delete the table, just like the regular hive example.
          Hide
          hadoopqa Hadoop QA added a comment -

          Testing JIRA OOZIE-2355

          Cleaning local git workspace

          ----------------------------

          +1 PATCH_APPLIES
          +1 CLEAN
          -1 RAW_PATCH_ANALYSIS
          . +1 the patch does not introduce any @author tags
          . +1 the patch does not introduce any tabs
          . +1 the patch does not introduce any trailing spaces
          . +1 the patch does not introduce any line longer than 132
          . -1 the patch does not add/modify any testcase
          +1 RAT
          . +1 the patch does not seem to introduce new RAT warnings
          +1 JAVADOC
          . +1 the patch does not seem to introduce new Javadoc warnings
          +1 COMPILE
          . +1 HEAD compiles
          . +1 patch compiles
          . +1 the patch does not seem to introduce new javac warnings
          +1 BACKWARDS_COMPATIBILITY
          . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations
          . +1 the patch does not modify JPA files
          -1 TESTS
          . Tests run: 1690
          . Tests failed: 1
          . Tests errors: 0

          . The patch failed the following testcases:

          . testUpdateSLA(org.apache.oozie.sla.TestSLAService)

          +1 DISTRO
          . +1 distro tarball builds with the patch

          ----------------------------
          -1 Overall result, please check the reported -1(s)

          The full output of the test-patch run is available at

          . https://builds.apache.org/job/oozie-trunk-precommit-build/2534/

          Show
          hadoopqa Hadoop QA added a comment - Testing JIRA OOZIE-2355 Cleaning local git workspace ---------------------------- +1 PATCH_APPLIES +1 CLEAN -1 RAW_PATCH_ANALYSIS . +1 the patch does not introduce any @author tags . +1 the patch does not introduce any tabs . +1 the patch does not introduce any trailing spaces . +1 the patch does not introduce any line longer than 132 . -1 the patch does not add/modify any testcase +1 RAT . +1 the patch does not seem to introduce new RAT warnings +1 JAVADOC . +1 the patch does not seem to introduce new Javadoc warnings +1 COMPILE . +1 HEAD compiles . +1 patch compiles . +1 the patch does not seem to introduce new javac warnings +1 BACKWARDS_COMPATIBILITY . +1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient annotations . +1 the patch does not modify JPA files -1 TESTS . Tests run: 1690 . Tests failed: 1 . Tests errors: 0 . The patch failed the following testcases: . testUpdateSLA(org.apache.oozie.sla.TestSLAService) +1 DISTRO . +1 distro tarball builds with the patch ---------------------------- -1 Overall result, please check the reported -1(s) The full output of the test-patch run is available at . https://builds.apache.org/job/oozie-trunk-precommit-build/2534/
          Hide
          rkanter Robert Kanter added a comment -

          Test failure unrelated

          Show
          rkanter Robert Kanter added a comment - Test failure unrelated
          Hide
          rohini Rohini Palaniswamy added a comment -

          +1

          Show
          rohini Rohini Palaniswamy added a comment - +1
          Hide
          rkanter Robert Kanter added a comment -

          Thanks for the review Rohini. Committed to trunk!

          Show
          rkanter Robert Kanter added a comment - Thanks for the review Rohini. Committed to trunk!
          Hide
          rkanter Robert Kanter added a comment -

          Closing issue; Oozie 4.3.0 is released.

          Show
          rkanter Robert Kanter added a comment - Closing issue; Oozie 4.3.0 is released.

            People

            • Assignee:
              rkanter Robert Kanter
              Reporter:
              rkanter Robert Kanter
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development