[SPARK-3562] Periodic cleanup event logs

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.4.0
• Component/s: Spark Core
• Target Version/s: 1.4.0
• Assignee: xukun
• Reporter: xukun
• Created: 17/Sep/14 06:35
• Updated: 26/Feb/15 21:24
• Resolved: 26/Feb/15 21:24

Description

If we run spark application frequently, it will write many spark event log into spark.eventLog.dir. After a long time later, there will be many spark event log that we do not concern in the spark.eventLog.dir.Periodic cleanups will ensure that logs older than this duration will be forgotten. It is no need to clean logs by hands.

Issue Links

• links to: [Github] Pull Request #2471 (viper-kun)
• links to: [Github] Pull Request #4214 (viper-kun)