Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6549

Add support for accessing the NFS gateway from the AIX NFS client

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.5.0
    • Component/s: nfs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We've identified two issues when trying to access the HDFS NFS Gateway from an AIX NFS client:

      1. In the case of COMMITs, the AIX NFS client will always send 4096, or a multiple of the page size, for the offset to be committed, even if fewer bytes than this have ever, or will ever, be written to the file. This will cause a write to a file from the AIX NFS client to hang on close unless the size of that file is a multiple of 4096.
      2. In the case of READDIR and READDIRPLUS, the AIX NFS client will send the same cookie verifier for a given directory seemingly forever after that directory is first accessed over NFS, instead of getting a new cookie verifier for every set of incremental readdir calls. This means that if a directory's mtime ever changes, the FS must be unmounted/remounted before readdir calls on that dir from AIX will ever succeed again.

      From my interpretation of RFC-1813, the NFS Gateway is in fact doing the correct thing in both cases, but we can introduce simple changes on the NFS Gateway side to be able to optionally work around these incompatibilities.

      1. HDFS-6549.patch
        14 kB
        Aaron T. Myers
      2. HDFS-6549.patch
        14 kB
        Aaron T. Myers
      3. HDFS-6549.patch
        14 kB
        Aaron T. Myers

        Activity

        Aaron T. Myers created issue -
        Aaron T. Myers made changes -
        Field Original Value New Value
        Project Hadoop Common [ 12310240 ] Hadoop HDFS [ 12310942 ]
        Key HADOOP-10712 HDFS-6549
        Affects Version/s 2.4.0 [ 12326143 ]
        Affects Version/s 2.4.0 [ 12326144 ]
        Target Version/s 2.5.0 [ 12326263 ] 2.5.0 [ 12326264 ]
        Component/s nfs [ 12320727 ]
        Component/s nfs [ 12320834 ]
        Aaron T. Myers made changes -
        Attachment HDFS-6549.patch [ 12650710 ]
        Aaron T. Myers made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Aaron T. Myers made changes -
        Attachment HDFS-6549.patch [ 12651329 ]
        Aaron T. Myers made changes -
        Attachment HDFS-6549.patch [ 12651475 ]
        Aaron T. Myers made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.5.0 [ 12326264 ]
        Resolution Fixed [ 1 ]
        Karthik Kambatla (Inactive) made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Aaron T. Myers
            Reporter:
            Aaron T. Myers
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development