[SLIDER-116] Log handling for long-lived applications

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Slider 0.60
• Component/s: agent-provider
• Sprint: Slider July #1, Slider September #1
• Assignee: Gour Saha
• Reporter: Sumit Mohanty
• Created: 07/Jun/14 14:25
• Updated: 24/Sep/14 21:01
• Resolved: 24/Sep/14 21:00

Description

Slider needs a solution for handling logs for long lived applications. The log files themselves could be huge and may or may not be ideal for pushing into HDFS. However, that should be an option. Otherwise, application owner should have an option of accessing logs from the local disk on hosts where container is/was active. Can YARN be configured to retain logs on a per application basis?

Issue Links

• is blocked by: YARN-2468 Log handling for LRS
• is related to: SLIDER-163 Change recommended app_log_dir value for HBase
• is related to: SLIDER-183 Long lived application support
• relates to: YARN-1104 NMs to support rolling logs of stdout & stderr
• relates to: YARN-1111 NM containerlogs servlet can't handle logs of more than a GB