[SPARK-16257] spark-ec2 script not updated for 1.6.2 release

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.2
• Fix Version/s: 1.6.3
• Component/s: EC2
• Assignee: Brian Uri
• Reporter: Brian Uri
• Created: 28/Jun/16 15:00
• Updated: 30/Jun/16 06:53
• Resolved: 30/Jun/16 06:52

Description

The spark-ec2 script which is used to create/destroy/manage Spark clusters on Amazon EC2 was not updated in the 1.6.2 release. The highest allowable Spark version in the script is still "1.6.1", and the default Spark branch is still "branch-1.5". As a result, the script cannot be used to create a 1.6.2 cluster without hand modifications.

Relevant file:
https://github.com/apache/spark/blob/eb6f6da484b4390c5b196d8426a49609b6a6fc7c/ec2/spark_ec2.py

Affected variables:
SPARK_EC2_VERSION
VALID_SPARK_VERSIONS
SPARK_TACHYON_MAP
DEFAULT_SPARK_EC2_BRANCH

Issue Links

• links to: [Github] Pull Request #13947 (briuri)