[YARN-7705] Create the container log directory with correct sticky bit in C code

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.1.0
• Fix Version/s: 3.1.0, 2.10.0, 3.0.1
• Component/s: nodemanager
• Hadoop Flags: Reviewed
• Assignee: Yufei Gu
• Reporter: Yufei Gu
• Created: 05/Jan/18 20:01
• Updated: 24/Jan/18 14:26
• Resolved: 13/Jan/18 01:42

Description

YARN-7363 created the container log directory in Java, which isn't able to set the correct sticky bit because of Java language limitation. Wrong sticky bit of log directory causes failure of reading log files inside the directory. To solve that, we need to do it in C code.

Issue Links

• is blocked by: YARN-7590 Improve container-executor validation check
• is related to: YARN-7363 ContainerLocalizer doesn't have a valid log4j config when using LinuxContainerExecutor