[YARN-5001] Aggregated Logs root directory is created with wrong group if nonexistent

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.0
• Fix Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2
• Component/s: log-aggregation, nodemanager, security
• Labels: oct16-easy
• Hadoop Flags: Reviewed
• Assignee: Haibo Chen
• Reporter: Haibo Chen
• Created: 26/Apr/16 18:07
• Updated: 01/Nov/16 21:35
• Resolved: 01/Nov/16 20:28

Description

The directory /tmp/logs, where the aggregated logs go, is supposed to be read by JHS. But if it is not created beforehand, it will be created by NodeManager with the group being the superuser set in HDFS. Files created under this directory will then inherit the supergroup as their groups. This leads to JHS to fail to read the container logs files under that directory if JHS is not running as a user that belongs to superuser.