Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3331

[spark-action] Inconsistency while parsing quoted Spark options

    XMLWordPrintableJSON

    Details

    • Type: Test
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 5.0.0
    • Fix Version/s: 5.1.0
    • Component/s: action
    • Labels:
      None

      Description

      According to the javadoc comment of SparkOptionsSplitter  we should unquote the option value if and only if it has quotes at both ends, and doesn't have any quotes in between. One of the listed examples shows that the following should remain quoted:

      key="value1 value2" "value3 value4"

      The current code unquotes this example which contradicts the javadoc comment.

      We should either change the javadoc or the code (after defining the correct behaviour) and we should also add a unit test.

        Attachments

        1. OOZIE-3331-1.patch
          2 kB
          Andras Salamon
        2. OOZIE-3331-wip.patch
          1 kB
          Andras Salamon

          Issue Links

            Activity

              People

              • Assignee:
                asalamon74 Andras Salamon
                Reporter:
                asalamon74 Andras Salamon
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: