[SPARK-1458] Expose sc.version in PySpark

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 1.1.0
• Component/s: PySpark, Spark Core
• Target Version/s: 1.1.0
• Assignee: Josh Rosen
• Reporter: Nicholas Chammas
• Created: 09/Apr/14 22:22
• Updated: 26/Jul/14 07:54
• Resolved: 26/Jul/14 07:54

Description

As discussed here, I think it would be nice if there was a way to programmatically determine what version of Spark you are running.

The potential use cases are not that important, but they include:

1. Branching your code based on what version of Spark is running.
2. Checking your version without having to quit and restart the Spark shell.

Right now in PySpark, I believe the only way to determine your version is by firing up the Spark shell and looking at the startup banner.

Issue Links

• links to: [Github] Pull Request #1596 (JoshRosen)