Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4253

Ignore spark.driver.host in yarn-cluster and standalone-cluster mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 1.1.2, 1.2.0
    • YARN
    • None

    Description

      We actually don't know where driver will be before it is launched in yarn-cluster mode. If we set spark.driver.host property, Spark will create Actor on the hostname or ip as setted, which will leads an error.
      So we should ignore this config item in yarn-cluster mode.

      As joshrosen] pointed, we also ignore it in standalone cluster mode.

      Attachments

        Activity

          People

            WangTaoTheTonic Tao Wang (Inactive)
            WangTaoTheTonic Tao Wang (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: