Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3112

SparkConfigrationService overwrites properties provided via --properties-file option in SparkAction

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0b1
    • Component/s: None
    • Labels:
      None

      Description

      SparkConfigurationService injects the config values as --conf to SparkSubmit. This will overwrite propties provided in the --properies-file option which is not the expected behavior.

        Attachments

        1. OOZIE-3112.01.patch
          13 kB
          Gézapeti
        2. OOZIE-3112.02.patch
          16 kB
          Gézapeti
        3. OOZIE-3112.03.patch
          114 kB
          Gézapeti
        4. OOZIE-3112.04.patch
          116 kB
          Gézapeti
        5. OOZIE-3112.05.patch
          20 kB
          Gézapeti
        6. OOZIE-3112.06.patch
          21 kB
          Gézapeti
        7. OOZIE-3112.07.patch
          21 kB
          Gézapeti
        8. OOZIE-3112.08.patch
          22 kB
          Gézapeti
        9. OOZIE-3112.09.patch
          23 kB
          Gézapeti

          Issue Links

            Activity

              People

              • Assignee:
                gezapeti Gézapeti
                Reporter:
                gezapeti Gézapeti
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: