Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31900

Client memory passed unvalidated to the JVM Xmx

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: 2.0.0, 3.0.0
    • Fix Version/s: None
    • Component/s: Spark Submit
    • Labels:
      None

      Description

      When launching in the client mode Spark launcher uses spark.driver.memory config (among other settings in the precedence order). Unlike the cluster mode, the client memory config is not trimmed and not validated to be a valid suffix for the Xmx option.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jira.shegalov Gera Shegalov
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: