[SPARK-1028] spark-shell automatically set MASTER fails

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.0, 0.8.1
• Fix Version/s: 0.9.1, 1.0.0
• Component/s: Spark Core
• Labels: spark-shell
• Assignee: Unassigned
• Reporter: Chen Chao
• Created: 15/Jan/14 19:05
• Updated: 02/Mar/14 18:56
• Resolved: 09/Feb/14 23:53

Description

spark-shell intends to set MASTER automatically if we do not provide the option when we start the shell , but there's a problem.
The condition is "if [[ "x" != "x$SPARK_MASTER_IP" && "y" != "y$SPARK_MASTER_PORT" ]];" we sure will set SPARK_MASTER_IP explicitly, the SPARK_MASTER_PORT option, however, we probably do not set just using spark default port 7077. So if we do not set SPARK_MASTER_PORT, the condition will never be true. We should just use default port if users do not set port explicitly I think.