Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5765

Revert CHMOD on the new dirs created-LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 2.8.0, 3.0.0-alpha1
    • 3.0.0-alpha2
    • None
    • None
    • Reviewed
    • Hide
      This change reverts YARN-5287 from 3.0.0-alpha1. chmod clears the set-group-ID bit of a regular file hence folder was getting reset with the rights.
      Show
      This change reverts YARN-5287 from 3.0.0-alpha1. chmod clears the set-group-ID bit of a regular file hence folder was getting reset with the rights.

    Description

      Earlier fix for YARN-5287 has been reverted due to this issue : LinuxContainerExecutor creates usercache/{userId}/appcache/{appId} with wrong group owner, causing Log aggregation and ShuffleHandler to fail because node manager process does not have permission to read the files under the directory.
      This can be easily reproduced by enabling LCE and submitting a MR example job as a user that does not belong to the same group that NM process belongs to.

      Attachments

        1. YARN-5765.001.patch
          2 kB
          Naganarasimha G R

        Activity

          People

            Naganarasimha Naganarasimha G R
            haibochen Haibo Chen
            Votes:
            0 Vote for this issue
            Watchers:
            13 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: