Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3331

[spark-action] Inconsistency while parsing quoted Spark options

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Test
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 5.0.0
    • 5.1.0
    • action
    • None

    Description

      According to the javadoc comment of SparkOptionsSplitter  we should unquote the option value if and only if it has quotes at both ends, and doesn't have any quotes in between. One of the listed examples shows that the following should remain quoted:

      key="value1 value2" "value3 value4"

      The current code unquotes this example which contradicts the javadoc comment.

      We should either change the javadoc or the code (after defining the correct behaviour) and we should also add a unit test.

      Attachments

        1. OOZIE-3331-wip.patch
          1 kB
          Andras Salamon
        2. OOZIE-3331-1.patch
          2 kB
          Andras Salamon

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            asalamon74 Andras Salamon
            asalamon74 Andras Salamon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment