Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2811

Add support for filtering out properties from SparkConfigurationService

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 5.0.0b1, 4.3.1
    • Component/s: None
    • Labels:
      None

      Description

      There is support for filtering out spark.yarn.jar, but it's changed to spark.yarn.jars in Spark2.
      We should add a general blacklist of properties instead of the current boolean of spark.configurations.ignore.spark.yarn.jar

        Attachments

        1. OOZIE-2811-001.patch
          28 kB
          Gézapeti
        2. OOZIE-2811-002.patch
          28 kB
          Gézapeti
        3. OOZIE-2811-003.patch
          28 kB
          Gézapeti
        4. OOZIE-2811-004.patch
          23 kB
          Gézapeti
        5. OOZIE-2811-005.patch
          23 kB
          Gézapeti
        6. OOZIE-2811-amend.patch
          0.9 kB
          Gézapeti

          Issue Links

            Activity

              People

              • Assignee:
                gezapeti Gézapeti
                Reporter:
                gezapeti Gézapeti
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: