Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3112

SparkConfigrationService overwrites properties provided via --properties-file option in SparkAction

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0b1
    • Component/s: None
    • Labels:
      None

      Description

      SparkConfigurationService injects the config values as --conf to SparkSubmit. This will overwrite propties provided in the --properies-file option which is not the expected behavior.

        Attachments

        1. OOZIE-3112.01.patch
          13 kB
          Gézapeti
        2. OOZIE-3112.02.patch
          16 kB
          Gézapeti
        3. OOZIE-3112.03.patch
          114 kB
          Gézapeti
        4. OOZIE-3112.04.patch
          116 kB
          Gézapeti
        5. OOZIE-3112.05.patch
          20 kB
          Gézapeti
        6. OOZIE-3112.06.patch
          21 kB
          Gézapeti
        7. OOZIE-3112.07.patch
          21 kB
          Gézapeti
        8. OOZIE-3112.08.patch
          22 kB
          Gézapeti
        9. OOZIE-3112.09.patch
          23 kB
          Gézapeti

        Issue Links

          Activity

            People

            • Assignee:
              gezapeti Gézapeti
              Reporter:
              gezapeti Gézapeti

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment