Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3779

yarn spark.yarn.applicationMaster.waitTries config should be changed to a time period

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.1.0
    • 1.3.0
    • YARN
    • None

    Description

      in pr https://github.com/apache/spark/pull/2577 I added support to use spark.yarn.applicationMaster.waitTries to client mode. But the time it waits between loops is different so it could be confusing to the user. We also don't document how long each loop is in the documentation so this config really isn't clear.

      We should just changed this config to be time based, ms or seconds.

      Attachments

        Issue Links

          Activity

            People

              sandyr Sandy Ryza
              tgraves Thomas Graves
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: