[SPARK-1186] Enrich the Spark Shell to support additional arguments.

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.9.0
• Fix Version/s: 1.0.0
• Assignee: Unassigned
• Reporter: Bernardo Gomez Palacio
• Created: 04/Mar/14 15:59
• Updated: 19/Apr/14 07:15
• Resolved: 19/Apr/14 07:15

Description

Enrich the Spark Shell functionality to support the following options.

spark-shell.sh

Usage: spark-shell [OPTIONS]

OPTIONS:
    -h  --help                           : Print this help information.
    -c  --cores                         : The maximum number of cores to be used by the Spark Shell.
    -em --executor-memory    : The memory used by each executor of the Spark Shell, the number
                                                is followed by m for megabytes or g for gigabytes, e.g. "1g".
    -dm --driver-memory         : The memory used by the Spark Shell, the number is followed
                                                by m for megabytes or g for gigabytes, e.g. "1g".
    -m  --master                       : A full string that describes the Spark Master, defaults to "local"
                                                 e.g. "spark://localhost:7077".
    --log-conf                           : Enables logging of the supplied SparkConf as INFO at start of the
                                                Spark Context.

e.g.
    spark-shell -m spark://localhost:7077 -c 4 -dm 512m -em 2g

*Note*: the options described above are not visually aligned due JIRA's rendering, in the bash CLI they are.

Issue Links

• is related to: SPARK-1318 Alignment of the Spark Shell with Spark Submit.