Hadoop Common
  1. Hadoop Common
  2. HADOOP-7172

SecureIO should not check owner on non-secure clusters that have no native support

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0, 0.23.0
    • Component/s: io, security
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The SecureIOUtils.openForRead function currently uses a racy stat/open combo if security is disabled and the native libraries are not available. This ends up shelling out to "ls -ld" which is very very slow. We've seen this cause significant performance regressions on clusters that match this profile.

      Since the racy permissions check doesn't buy us any security anyway, we should just fall back to a normal "open" without any stat() at all, if we can't use the native support to do it efficiently.

      1. hadoop-7172.txt
        3 kB
        Todd Lipcon
      2. hadoop-7172.txt
        3 kB
        Todd Lipcon
      3. hadoop-7172.txt
        2 kB
        Todd Lipcon

        Issue Links

          Activity

          Gavin made changes -
          Link This issue depends upon HADOOP-7115 [ HADOOP-7115 ]
          Gavin made changes -
          Link This issue depends on HADOOP-7115 [ HADOOP-7115 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Eli Collins made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Resolution Fixed [ 1 ]
          Eli Collins made changes -
          Hadoop Flags [Reviewed]
          Fix Version/s 0.23.0 [ 12315569 ]
          Todd Lipcon made changes -
          Attachment hadoop-7172.txt [ 12473024 ]
          Todd Lipcon made changes -
          Attachment hadoop-7172.txt [ 12473021 ]
          Todd Lipcon made changes -
          Assignee Todd Lipcon [ tlipcon ]
          Todd Lipcon made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Attachment hadoop-7172.txt [ 12472920 ]
          Todd Lipcon made changes -
          Field Original Value New Value
          Link This issue depends on HADOOP-7115 [ HADOOP-7115 ]
          Todd Lipcon created issue -

            People

            • Assignee:
              Todd Lipcon
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development