Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-2811

Add support for filtering out properties from SparkConfigurationService

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 5.0.0b1, 4.3.1
    • None
    • None

    Description

      There is support for filtering out spark.yarn.jar, but it's changed to spark.yarn.jars in Spark2.
      We should add a general blacklist of properties instead of the current boolean of spark.configurations.ignore.spark.yarn.jar

      Attachments

        1. OOZIE-2811-001.patch
          28 kB
          Gézapeti
        2. OOZIE-2811-002.patch
          28 kB
          Gézapeti
        3. OOZIE-2811-003.patch
          28 kB
          Gézapeti
        4. OOZIE-2811-004.patch
          23 kB
          Gézapeti
        5. OOZIE-2811-005.patch
          23 kB
          Gézapeti
        6. OOZIE-2811-amend.patch
          0.9 kB
          Gézapeti

        Issue Links

          links to

          Web Link review board

          Activity

            People

              gezapeti Gézapeti
              gezapeti Gézapeti
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: