[SPARK-725] Ran out of disk space on EC2 master due to Ganglia logs

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.7.0
• Component/s: EC2
• Assignee: Unassigned
• Reporter: Josh Rosen
• Created: 05/Apr/13 19:29
• Updated: 26/Feb/15 00:05
• Resolved: 26/Feb/15 00:05

Description

This morning, I started a Spark Standalone cluster on EC2 using 50 m1.medium instances. When I tried to rebuild Spark ~5.5 hours later, the build failed because the master ran out of disk space. It looks like /var/lib/ganglia/rrds/spark grew to 4.2 gigabytes, using over half of the AMI's EBS disk space.

Is there a default setting that we can change to place a harder limit on the total amount of space used by Ganglia to prevent this from happening?