Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-3550

Spark action incorrectly splits spark-opts with -- in value

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • action
    • None

    Description

      When providing the spark-opts option to the spark action, a double dash within values is incorrectly interpreted as the start of a new cli flag.  To reproduce add a test case to sharelib/spark/src/test/java/org/apache/oozie/action/hadoop/TestSparkOptionsSplitter.java expecting:

      {"--option val--ue",
          Arrays.asList("--option", "val--ue")}
      

      Instead the result is:

      java.lang.AssertionError:
      Expecting:
       <["--option", "val", "--ue"]>
      to contain exactly (and in same order):
       <["--option", "val--ue"]>
      but some elements were not found:
       <["val--ue"]>
      and others were not expected:
       <["val", "--ue"]>
      

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            ebernhardson Erik Bernhardson
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: