[SPARK-13350] Configuration documentation incorrectly states that PYSPARK_PYTHON's default is "python"

• Type: Documentation
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Fix Version/s: 1.6.1, 2.0.0
• Component/s: Documentation
• Labels: newbie
• Assignee: Christopher Aycock
• Reporter: Christopher Aycock
• Created: 16/Feb/16 23:34
• Updated: 17/Feb/16 19:25
• Resolved: 17/Feb/16 19:25

Description

The configuration documentation states that the environment variable PYSPARK_PYTHON has a default value of python:

http://spark.apache.org/docs/latest/configuration.html

In fact, the default is python2.7:

https://github.com/apache/spark/blob/4f60651cbec1b4c9cc2e6d832ace77e89a233f3a/bin/pyspark#L39-L45

The change that introduced this was discussed here:

https://github.com/apache/spark/pull/2651

Would it be possible to highlight this in the documentation?

Issue Links

• links to: [Github] Pull Request #11239 (chrisaycock)