[SPARK-17554] spark.executor.memory option not working

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Invalid
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Sankar Mittapally
• Created: 15/Sep/16 09:07
• Updated: 15/Sep/16 09:15
• Resolved: 15/Sep/16 09:15

Description

Hi,

I am new to spark, I have spark cluster with 5 slaves(Each one have 2 cores and 4g RAM). In spark cluster dashboard I am seeing memory per node is 1gb, I tried to increase it to 2g by using this parameter spark.executor.memory 2g in defaults.conf but it didn't work. I want to increase the memory. Please let me know how to do that.