Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27962

Propagate subprocess stdout when subprocess exits with nonzero status in deploy.RRunner

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: In Progress
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1.0
    • Fix Version/s: None
    • Component/s: Deploy, Spark Core, SparkR
    • Labels:
      None

      Description

      When the R process launched inĀ org.apache.spark.deploy.RRunner terminates with a nonzero status code, only the status code is passed on in the SparkUserAppException.

      Although the subprocess' stdout is continually piped to System.out, it would be useful for users without access to the JVM's stdout to also capture the last few lines of the R process and pass it along in the exception message.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                jeremyliu Jeremy Liu
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated: