Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6549

Add support for accessing the NFS gateway from the AIX NFS client

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.5.0
    • Component/s: nfs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      We've identified two issues when trying to access the HDFS NFS Gateway from an AIX NFS client:

      1. In the case of COMMITs, the AIX NFS client will always send 4096, or a multiple of the page size, for the offset to be committed, even if fewer bytes than this have ever, or will ever, be written to the file. This will cause a write to a file from the AIX NFS client to hang on close unless the size of that file is a multiple of 4096.
      2. In the case of READDIR and READDIRPLUS, the AIX NFS client will send the same cookie verifier for a given directory seemingly forever after that directory is first accessed over NFS, instead of getting a new cookie verifier for every set of incremental readdir calls. This means that if a directory's mtime ever changes, the FS must be unmounted/remounted before readdir calls on that dir from AIX will ever succeed again.

      From my interpretation of RFC-1813, the NFS Gateway is in fact doing the correct thing in both cases, but we can introduce simple changes on the NFS Gateway side to be able to optionally work around these incompatibilities.

      1. HDFS-6549.patch
        14 kB
        Aaron T. Myers
      2. HDFS-6549.patch
        14 kB
        Aaron T. Myers
      3. HDFS-6549.patch
        14 kB
        Aaron T. Myers

        Activity

        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-Mapreduce-trunk #1807 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1807/)
        HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022)

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1807 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1807/ ) HDFS-6549 . Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-Hdfs-trunk #1780 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1780/)
        HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022)

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-Hdfs-trunk #1780 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1780/ ) HDFS-6549 . Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/589/)
        HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022)

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Yarn-trunk #589 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/589/ ) HDFS-6549 . Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #5738 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5738/)
        HDFS-6549. Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022)

        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #5738 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5738/ ) HDFS-6549 . Add support for accessing the NFS gateway from the AIX NFS client. Contributed by Aaron T. Myers. (atm: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1604022 ) /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/conf/NfsConfigKeys.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/WriteManager.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/test/java/org/apache/hadoop/hdfs/nfs/nfs3/TestWrites.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Aaron T. Myers added a comment -

        I've just committed this to trunk and branch-2.

        Thanks a lot for the reviews, Brandon and Juan.

        Show
        Aaron T. Myers added a comment - I've just committed this to trunk and branch-2. Thanks a lot for the reviews, Brandon and Juan.
        Hide
        Aaron T. Myers added a comment -

        Sure is! Good catch, Juan. Attached patch fixes that typo.

        I'm going to go ahead and commit this based on Brandon's +1 without waiting for test-patch since the difference is only a docs typo.

        Show
        Aaron T. Myers added a comment - Sure is! Good catch, Juan. Attached patch fixes that typo. I'm going to go ahead and commit this based on Brandon's +1 without waiting for test-patch since the difference is only a docs typo.
        Hide
        Juan Yu added a comment -

        is this a typo?
        <value>true></value>

        Show
        Juan Yu added a comment - is this a typo? <value>true></value>
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12651329/HDFS-6549.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.hdfs.server.datanode.TestBPOfferService

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7173//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7173//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12651329/HDFS-6549.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.hdfs.server.datanode.TestBPOfferService +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7173//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7173//console This message is automatically generated.
        Hide
        Brandon Li added a comment -

        +1 to the latest patch.

        Show
        Brandon Li added a comment - +1 to the latest patch.
        Hide
        Aaron T. Myers added a comment -

        Great, thanks. Here's an updated patch which adds an explanation about why AIX compat mode should not be enabled in general.

        Show
        Aaron T. Myers added a comment - Great, thanks. Here's an updated patch which adds an explanation about why AIX compat mode should not be enabled in general.
        Hide
        Brandon Li added a comment -

        Yes.
        +1 once the doc is updated.

        Show
        Brandon Li added a comment - Yes. +1 once the doc is updated.
        Hide
        Aaron T. Myers added a comment -

        All makes sense. So are you good with this patch if I update the NFS user doc to explain why AIX compatibility mode is not recommended in general?

        Show
        Aaron T. Myers added a comment - All makes sense. So are you good with this patch if I update the NFS user doc to explain why AIX compatibility mode is not recommended in general?
        Hide
        Brandon Li added a comment -

        Guess AIX NFS server doesn't put mtime in the verifier and uses it in a different way.

        The patch should be able to fix the AIX NFS client problems. The only thing is that, the aix.compatibility.mode should not be recommended for non AIX client for the following reasons:
        1. NFS client considers it's safe to clear the buffer cache as long as the data is committed. In aix.compatibility.mode, NFS could returns commit success even when the data is not received.
        2. Many NFS clients restart directory listing once it encounters verifier mismatch error. In aix.compatibility.mode, client may not get the most recent directory content.

        Show
        Brandon Li added a comment - Guess AIX NFS server doesn't put mtime in the verifier and uses it in a different way. The patch should be able to fix the AIX NFS client problems. The only thing is that, the aix.compatibility.mode should not be recommended for non AIX client for the following reasons: 1. NFS client considers it's safe to clear the buffer cache as long as the data is committed. In aix.compatibility.mode, NFS could returns commit success even when the data is not received. 2. Many NFS clients restart directory listing once it encounters verifier mismatch error. In aix.compatibility.mode, client may not get the most recent directory content.
        Hide
        Aaron T. Myers added a comment -

        Large directory may need multiple READDIR/READDIRPLUS requests. Many NFS client implementations send 0 as the verifier for the first READDIR/READDIRPLUS RPC request. In the AIX case, after it grabs a verifier from server it will always use the same verifier even in the initial READDIR/READIRPLUS request when it accesses the same directory again. Is my understanding correct?

        Correct, this is exactly what I've observed.

        Show
        Aaron T. Myers added a comment - Large directory may need multiple READDIR/READDIRPLUS requests. Many NFS client implementations send 0 as the verifier for the first READDIR/READDIRPLUS RPC request. In the AIX case, after it grabs a verifier from server it will always use the same verifier even in the initial READDIR/READIRPLUS request when it accesses the same directory again. Is my understanding correct? Correct, this is exactly what I've observed.
        Hide
        Brandon Li added a comment -

        This sometimes happens with some traditional NFS server/client implementations: when the NFS client does READDIR/READDIRPLUS with a huge directory which keeps changing, the READDIR/READDIRPLUS can never finish because the verifier changes and NFS client has to restart the listing request before it finishes. But based on what you described, the AIX client is a different case.

        Large directory may need multiple READDIR/READDIRPLUS requests. Many NFS client implementations send 0 as the verifier for the first READDIR/READDIRPLUS RPC request. In the AIX case, after it grabs a verifier from server it will always use the same verifier even in the initial READDIR/READIRPLUS request when it accesses the same directory again. Is my understanding correct?

        Show
        Brandon Li added a comment - This sometimes happens with some traditional NFS server/client implementations: when the NFS client does READDIR/READDIRPLUS with a huge directory which keeps changing, the READDIR/READDIRPLUS can never finish because the verifier changes and NFS client has to restart the listing request before it finishes. But based on what you described, the AIX client is a different case. Large directory may need multiple READDIR/READDIRPLUS requests. Many NFS client implementations send 0 as the verifier for the first READDIR/READDIRPLUS RPC request. In the AIX case, after it grabs a verifier from server it will always use the same verifier even in the initial READDIR/READIRPLUS request when it accesses the same directory again. Is my understanding correct?
        Hide
        Aaron T. Myers added a comment -

        Thanks much.

        Show
        Aaron T. Myers added a comment - Thanks much.
        Hide
        Brandon Li added a comment -

        Sure. I will review it shortly.

        Show
        Brandon Li added a comment - Sure. I will review it shortly.
        Hide
        Aaron T. Myers added a comment -

        Brandon Li - would you mind taking a look at this patch? Thanks a lot.

        Show
        Aaron T. Myers added a comment - Brandon Li - would you mind taking a look at this patch? Thanks a lot.
        Hide
        Aaron T. Myers added a comment -

        I'm quite confident the test failure is unrelated. It failed with this error:

        Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see:  http://wiki.apache.org/hadoop/BindException
        
        Show
        Aaron T. Myers added a comment - I'm quite confident the test failure is unrelated. It failed with this error: Problem binding to [0.0.0.0:50020] java.net.BindException: Address already in use; For more details see: http: //wiki.apache.org/hadoop/BindException
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12650710/HDFS-6549.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        +1 tests included. The patch appears to include 1 new or modified test files.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.hdfs.TestDatanodeConfig

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7142//testReport/
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7142//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12650710/HDFS-6549.patch against trunk revision . +1 @author . The patch does not contain any @author tags. +1 tests included . The patch appears to include 1 new or modified test files. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. +1 findbugs . The patch does not introduce any new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.hdfs.TestDatanodeConfig +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/7142//testReport/ Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7142//console This message is automatically generated.
        Hide
        Aaron T. Myers added a comment -

        Here's a patch which addresses the issue by introducing an "AIX compatibility mode" configuration setting. When this is enabled, very slight behavior changes are introduced in the case of COMMITs and READDIR/READDIRPLUS calls as described above. No other behavior changes are introduced as part of this change.

        In addition to the provided test case, I've also tested this manually from an AIX client machine. It works as expected.

        Please review.

        Show
        Aaron T. Myers added a comment - Here's a patch which addresses the issue by introducing an "AIX compatibility mode" configuration setting. When this is enabled, very slight behavior changes are introduced in the case of COMMITs and READDIR/READDIRPLUS calls as described above. No other behavior changes are introduced as part of this change. In addition to the provided test case, I've also tested this manually from an AIX client machine. It works as expected. Please review.

          People

          • Assignee:
            Aaron T. Myers
            Reporter:
            Aaron T. Myers
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development