Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7367

HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: hdfs-client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      When both short-circuit read and SASL on DataTransferProtocol are enabled, the server side tries to negotiate SASL on the operation to allocate a new shared memory slot. However, the transport for this operation is the Unix domain socket (not TCP), and the client always assumes that Unix domain socket traffic is trustworthy. The end result is that the server side still attempts SASL negotiation, and it fails with an exception while erroneously trying to parse the domain socket address as if it were a network address. The read succeeds, but only because we fallback to a read through the DataNode TCP server. It's not a short-circuit read.

        Attachments

        1. HDFS-7367.1.patch
          1 kB
          Chris Nauroth

          Issue Links

            Activity

              People

              • Assignee:
                cnauroth Chris Nauroth
                Reporter:
                cnauroth Chris Nauroth
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: