[SPARK-4606] SparkSubmitDriverBootstrapper does not propagate EOF to child JVM

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.1, 1.2.0
• Fix Version/s: 1.1.2, 1.2.1, 1.3.0
• Component/s: Spark Core
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 25/Nov/14 20:08
• Updated: 24/Dec/14 03:10
• Resolved: 24/Dec/14 00:09

Description

Run this with "spark.driver.extraJavaOptions" set in your spark-defaults.conf:

  echo "" | spark-shell --master local -Xnojline

You'll end up with a child process that cannot read from stdin (you can CTRL-C out of it though). That's because when the bootstrapper's stdin reaches EOF, that is not propagated to the child JVM that's actually doing the reading.

Issue Links

• links to: [Github] Pull Request #3460 (vanzin)