Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11854

The exit code of spark-submit is still 0 when an yarn application fails

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.5.1
    • None
    • Spark Core, YARN

    Description

      When an yarn application fails (yarn-cluster yarn-client mode), the exit code of spark-submit is still 0. It's hard for people to write some automatic scripts to run spark jobs in yarn because the failure can not be detected in these scripts.

      Attachments

        Issue Links

          Activity

            People

              zsxwing Shixiong Zhu
              sams sam
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: