[SPARK-12022] spark-shell cannot run on master created with spark-ec2

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 1.5.1
• Component/s: EC2, Spark Shell, SQL
• Labels: ec2 spark-shell sql

Environment

AWS EC2

• Assignee: Unassigned
• Reporter: Simeon Simeonov
• Created: 27/Nov/15 03:49
• Updated: 09/Feb/16 09:12
• Resolved: 09/Feb/16 09:12

Description

Running ./bin/spark-shell on the master node created with spark-ec2 results in:

java.lang.RuntimeException: java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable. Current permissions are: rwx--x--x
	at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522)
	at org.apache.spark.sql.hive.client.ClientWrapper.<init>(ClientWrapper.scala:171)
	at org.apache.spark.sql.hive.HiveContext.executionHive$lzycompute(HiveContext.scala:162)
	at org.apache.spark.sql.hive.HiveContext.executionHive(HiveContext.scala:160)
	at org.apache.spark.sql.hive.HiveContext.<init>(HiveContext.scala:167)