Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16257

spark-ec2 script not updated for 1.6.2 release

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.6.2
    • Fix Version/s: 1.6.3
    • Component/s: EC2
    • Labels:
      None

      Description

      The spark-ec2 script which is used to create/destroy/manage Spark clusters on Amazon EC2 was not updated in the 1.6.2 release. The highest allowable Spark version in the script is still "1.6.1", and the default Spark branch is still "branch-1.5". As a result, the script cannot be used to create a 1.6.2 cluster without hand modifications.

      Relevant file:
      https://github.com/apache/spark/blob/eb6f6da484b4390c5b196d8426a49609b6a6fc7c/ec2/spark_ec2.py

      Affected variables:
      SPARK_EC2_VERSION
      VALID_SPARK_VERSIONS
      SPARK_TACHYON_MAP
      DEFAULT_SPARK_EC2_BRANCH

        Attachments

          Activity

            People

            • Assignee:
              briuri Brian Uri
              Reporter:
              briuri Brian Uri
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: