Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-5130

yarn-cluster mode should not be considered as client mode in spark-submit

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.2.0
    • 1.2.1, 1.3.0
    • Deploy
    • None

    Description

      spark-submit will choose SparkSubmitDriverBootstrapper or SparkSubmit to launch according to --deploy-mode.
      When submitting application using yarn-cluster we do not need to specify --deploy-mode so spark-submit will launch SparkSubmitDriverBootstrapper, and it is not proper to do this.

      Attachments

        Activity

          People

            WangTaoTheTonic Tao Wang (Inactive)
            WangTaoTheTonic Tao Wang (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: