Details
-
Bug
-
Status: Resolved
-
Blocker
-
Resolution: Fixed
-
2.8.0, 3.0.0-alpha1
-
None
-
None
-
Reviewed
-
Description
Earlier fix for YARN-5287 has been reverted due to this issue : LinuxContainerExecutor creates usercache/{userId}/appcache/{appId} with wrong group owner, causing Log aggregation and ShuffleHandler to fail because node manager process does not have permission to read the files under the directory.
This can be easily reproduced by enabling LCE and submitting a MR example job as a user that does not belong to the same group that NM process belongs to.