[SPARK-20653] Add auto-cleanup of old elements to the new app state store

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Spark Core
• Assignee: Marcelo Masiero Vanzin
• Reporter: Marcelo Masiero Vanzin
• Created: 08/May/17 18:07
• Updated: 18/Dec/17 20:09
• Resolved: 18/Dec/17 20:09

Description

See spec in parent issue (SPARK-18085) for more details.

This task tracks restoring the functionality of the old UI where one could set up a limit on the number of certain elements to be stored (e.g. only store the most recent X tasks). This allows applications to control how much UI data is kept around so that disk (or memory) usage is bounded.

Issue Links

• links to: [Github] Pull Request #19751 (vanzin)