[YARN-3929] Uncleaning option for local app log files with log-aggregation feature

• Type: New Feature
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 2.4.0, 2.6.0
• Component/s: log-aggregation
• Target Version/s: 2.6.0
• Assignee: Unassigned
• Reporter: Dongwook Kwon
• Created: 16/Jul/15 08:42
• Updated: 06/Jul/18 00:09

Description

Although it makes sense to delete local app log files once AppLogAggregator copied all files into remote location(HDFS), I have some use cases that need to leave local app log files after it's copied to HDFS. Mostly it's for own backup purpose. I would like to use log-aggregation feature of YARN and want to back up app log files too. Without this option, files has to copy from HDFS to local again.

Issue Links

• links to: GitHub Pull Request #401