Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5765

Revert CHMOD on the new dirs created-LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.8.0, 3.0.0-alpha1
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This change reverts YARN-5287 from 3.0.0-alpha1. chmod clears the set-group-ID bit of a regular file hence folder was getting reset with the rights.
      Show
      This change reverts YARN-5287 from 3.0.0-alpha1. chmod clears the set-group-ID bit of a regular file hence folder was getting reset with the rights.

      Description

      Earlier fix for YARN-5287 has been reverted due to this issue : LinuxContainerExecutor creates usercache/{userId}/appcache/{appId} with wrong group owner, causing Log aggregation and ShuffleHandler to fail because node manager process does not have permission to read the files under the directory.
      This can be easily reproduced by enabling LCE and submitting a MR example job as a user that does not belong to the same group that NM process belongs to.

        Attachments

        1. YARN-5765.001.patch
          2 kB
          Naganarasimha G R

          Issue Links

            Activity

              People

              • Assignee:
                Naganarasimha Naganarasimha G R
                Reporter:
                haibochen Haibo Chen
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: