[YARN-3154] Should not upload partial logs for MR jobs or other "short-running' applications

• Type: Sub-task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.7.0, 2.6.4, 3.0.0-alpha1
• Component/s: nodemanager, resourcemanager
• Target Version/s: 2.7.0, 2.6.4
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: Applications which made use of the LogAggregationContext in their application will need to revisit this code in order to make sure that their logs continue to get rolled out.
• Assignee: Xuan Gong Assign to me
• Reporter: Xuan Gong
• Created: 06/Feb/15 21:37
• Updated: 30/Aug/16 01:27
• Resolved: 12/Mar/15 20:36

Description

Currently, if we are running a MR job, and we do not set the log interval properly, we will have their partial logs uploaded and then removed from the local filesystem which is not right.

We only upload the partial logs for LRS applications.

Issue Links

• relates to: YARN-3089 LinuxContainerExecutor does not handle file arguments to deleteAsUser