[SPARK-20654] Add controls for how much disk the SHS can use

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 08/May/17 18:08
• Updated: 29/Dec/17 16:44
• Resolved: 29/Dec/17 16:44

Description

See spec in parent issue (SPARK-18085) for more details.

This task tracks adding controls to the SHS so that it caps its disk usage at some threshold, instead of filling up disks and then running into errors.

Issue Links

• links to: [Github] Pull Request #20011 (vanzin)