Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6080

Improve NFS gateway performance by making rtmax and wtmax configurable

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.4.0
    • Component/s: nfs, performance
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Right now rtmax and wtmax are hardcoded in RpcProgramNFS3. These dictate the maximum read and write capacity of the server. Therefore, these affect the read and write performance.

      We ran performance tests with 1mb, 100mb, and 1GB files. We noticed significant performance decline with the size increase when compared to fuse. We realized that the issue was with the hardcoded rtmax size(64k).
      When we increased the rtmax to 1MB, we got a 10x improvement in performance.

      NFS reads:
      ------------------------------------------------------------------------------------------------------

      File Size Run 1 Run 2 Run 3 Average Std. Dev.
      testFile100Mb 104857600 23.131158137 19.24552955 19.793332866 20.723340184333335 1.7172094782219731
      testFile1Gb 1073741824 219.108776636 201.064032255 217.433909843 212.53557291133333 8.14037175506561
      testFile1Mb 1048576 0.330546906 0.256391808 0.28730168 0.2914134646666667 0.030412987573361663

      ------------------------------------------------------------------------------------------------------
      Fuse reads:
      ---------------------------------------------------------------------------------------------------

      File Size Run 1 Run 2 Run 3 Average Std. Dev.
      testFile100Mb 104857600 2.394459443 2.695265191 2.50046517 2.5300632679999997 0.12457410127142007
      testFile1Gb 1073741824 25.03324924 24.155102554 24.901525525 24.696625772999997 0.386672412437576
      testFile1Mb 1048576 0.271615094 0.270835986 0.271796438 0.2714158393333333 0.0004166483951065848

      ---------------------------------------------------------------------------------------------------
      (NFS read after rtmax = 1MB)
      ----------------------------------------------------------------------------------------------

      File Size Run 1 Run 2 Run 3 Average Std. Dev.
      testFile100Mb 104857600 3.655261869 3.438676067 3.557464787 3.5504675743333336 0.0885591069882058
      testFile1Gb 1073741824 34.663612417 37.32089122 37.997718857 36.660740831333335 1.4389615098060426
      testFile1Mb 1048576 0.115602858 0.106826253 0.125229976 0.11588636233333334 0.007515962395481867

      ----------------------------------------------------------------------------------------------

      1. HDFS-6080.patch
        5 kB
        Abin Shahab
      2. HDFS-6080.patch
        7 kB
        Abin Shahab
      3. HDFS-6080.patch
        7 kB
        Abin Shahab
      4. HDFS-6080.patch
        10 kB
        Brandon Li

        Activity

        Abin Shahab created issue -
        Abin Shahab made changes -
        Field Original Value New Value
        Status Open [ 1 ] In Progress [ 3 ]
        Hide
        Abin Shahab added a comment -

        Parametrizes rtmax, wtmax, and dtperf.

        Show
        Abin Shahab added a comment - Parametrizes rtmax, wtmax, and dtperf.
        Abin Shahab made changes -
        Attachment HDFS-6080.patch [ 12633583 ]
        Abin Shahab made changes -
        Status In Progress [ 3 ] Patch Available [ 10002 ]
        Fix Version/s 2.3.0 [ 12325255 ]
        Fix Version/s 2.2.0 [ 12325049 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12633583/HDFS-6080.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.fs.TestHdfsNativeCodeLoader
        org.apache.hadoop.hdfs.TestFileAppend4

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12633583/HDFS-6080.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.fs.TestHdfsNativeCodeLoader org.apache.hadoop.hdfs.TestFileAppend4 +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6360//console This message is automatically generated.
        Brandon Li made changes -
        Fix Version/s 2.2.0 [ 12325049 ]
        Fix Version/s 2.3.0 [ 12325255 ]
        Brandon Li made changes -
        Component/s nfs [ 12320727 ]
        Brandon Li made changes -
        Issue Type Bug [ 1 ] Improvement [ 4 ]
        Hide
        Abin Shahab added a comment -

        I'm wondering how to test this without orchestrating everything else RpcProgramNFS3 needs. However, at it's heart, this change adds 3 configurable parameters, and so it maybe fine to verify this outside of the test suite.

        Show
        Abin Shahab added a comment - I'm wondering how to test this without orchestrating everything else RpcProgramNFS3 needs. However, at it's heart, this change adds 3 configurable parameters, and so it maybe fine to verify this outside of the test suite.
        Brandon Li made changes -
        Component/s performance [ 12316501 ]
        Hide
        Brandon Li added a comment -

        Abin Shahab, thanks for the patch. Very nice work!
        The patch looks good. Some minor comments:
        1. According to the discussion in HDFS-6050, we should change dfs.nfs3.rtmax/dfs.nfs3.wtmax/dfs.nfs3/dtmax to hadoop.nfs.xxx. We can keep them in NFS3Constants.java for now. HDFS-6056 will move the NFS configuration property to a different file.
        2. HdfsNfsGateway.apt.vm: the property dfs.namenode.accesstime.precision is pushed down to a wrong place. It might be better to order them like the following:

           * If the client mounts the export with access time update allowed, make sure the following
            ... ... .
        ----
        <property>
          <name>dfs.namenode.accesstime.precision</name>
          <value>3600000</value>
          <description>The access time for HDFS file is precise upto this value.
            The default value is 1 hour. Setting a value of 0 disables
            access times for HDFS.
          </description>
        </property>
        ----
           * For optimal performance, it is recommended that rtmax be updated to
             1MB. However, note that this 1MB is a per client allocation, and not
             from a shared memory pool, and therefore a larger value may adversely
             affect small reads, consuming a lot of memory. The NFS gateway heap size
            can be increased by update HADOOP_NFS3_OPTS in hadoop-env.sh. 
           The maximum value of this property is 1MB.
        ----
        <property>
          <name>hadoop.nfs.rtmax</name>
          <value>65536</value>
          <description>This is the maximum size in bytes of a READ request
            supported by the NFS gateway. If you change this, make sure you
            also update the nfs mount's rsize(add rsize= # of bytes to the
            mount directive).
          </description>
        </property>
        ----
        ----
        <property>
          <name>hadoop.nfs.wtmax</name>
          <value>65536</value>
          <description>This is the maximum size in bytes of a WRITE request
            supported by the NFS gateway. If you change this, make sure you
            also update the nfs mount's wsize(add wsize= # of bytes to the
            mount directive).
          </description>
        </property>
        
        

        3. since you already modified RpcProgramNfs3.java, it would be nice to log an error at line 555 to indicate the link size is larger than max transfer size.

        Show
        Brandon Li added a comment - Abin Shahab , thanks for the patch. Very nice work! The patch looks good. Some minor comments: 1. According to the discussion in HDFS-6050 , we should change dfs.nfs3.rtmax/dfs.nfs3.wtmax/dfs.nfs3/dtmax to hadoop.nfs.xxx. We can keep them in NFS3Constants.java for now. HDFS-6056 will move the NFS configuration property to a different file. 2. HdfsNfsGateway.apt.vm: the property dfs.namenode.accesstime.precision is pushed down to a wrong place. It might be better to order them like the following: * If the client mounts the export with access time update allowed, make sure the following ... ... . ---- <property> <name>dfs.namenode.accesstime.precision</name> <value>3600000</value> <description>The access time for HDFS file is precise upto this value. The default value is 1 hour. Setting a value of 0 disables access times for HDFS. </description> </property> ---- * For optimal performance, it is recommended that rtmax be updated to 1MB. However, note that this 1MB is a per client allocation, and not from a shared memory pool, and therefore a larger value may adversely affect small reads, consuming a lot of memory. The NFS gateway heap size can be increased by update HADOOP_NFS3_OPTS in hadoop-env.sh. The maximum value of this property is 1MB. ---- <property> <name>hadoop.nfs.rtmax</name> <value>65536</value> <description>This is the maximum size in bytes of a READ request supported by the NFS gateway. If you change this, make sure you also update the nfs mount's rsize(add rsize= # of bytes to the mount directive). </description> </property> ---- ---- <property> <name>hadoop.nfs.wtmax</name> <value>65536</value> <description>This is the maximum size in bytes of a WRITE request supported by the NFS gateway. If you change this, make sure you also update the nfs mount's wsize(add wsize= # of bytes to the mount directive). </description> </property> 3. since you already modified RpcProgramNfs3.java, it would be nice to log an error at line 555 to indicate the link size is larger than max transfer size.
        Brandon Li made changes -
        Summary rtmax and wtmax for NFS-hdfs-gateway should be configurable Improve NFS gateway performance by making rtmax and wtmax configurable
        Hide
        Abin Shahab added a comment -

        Code review fixes.

        Show
        Abin Shahab added a comment - Code review fixes.
        Abin Shahab made changes -
        Attachment HDFS-6080.patch [ 12633847 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12633847/HDFS-6080.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.fs.TestHdfsNativeCodeLoader

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12633847/HDFS-6080.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.fs.TestHdfsNativeCodeLoader +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6369//console This message is automatically generated.
        Hide
        Brandon Li added a comment -

        Abin Shahab, given your test result and hdfs file size is in MB size usually, I think we may want to keep 1MB as default. The user can always change it to a smaller size when needed. What do you think?

        Show
        Brandon Li added a comment - Abin Shahab , given your test result and hdfs file size is in MB size usually, I think we may want to keep 1MB as default. The user can always change it to a smaller size when needed. What do you think?
        Hide
        Abin Shahab added a comment -

        1MB default means we need to update client instructions to include a rsize=1048576
        Do you want that in the docs too?

        Show
        Abin Shahab added a comment - 1MB default means we need to update client instructions to include a rsize=1048576 Do you want that in the docs too?
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12633847/HDFS-6080.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.fs.TestHdfsNativeCodeLoader

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12633847/HDFS-6080.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.fs.TestHdfsNativeCodeLoader +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6374//console This message is automatically generated.
        Hide
        Brandon Li added a comment -

        Yes. Let's update the doc too. If the user doesn't change the mount option and the nfs client uses 32kb or 64kb instead, the 1MB setting will not take effect so it hurts nothing.

        Show
        Brandon Li added a comment - Yes. Let's update the doc too. If the user doesn't change the mount option and the nfs client uses 32kb or 64kb instead, the 1MB setting will not take effect so it hurts nothing.
        Hide
        Abin Shahab added a comment -

        set rsize=1MB

        Show
        Abin Shahab added a comment - set rsize=1MB
        Abin Shahab made changes -
        Attachment HDFS-6080.patch [ 12634050 ]
        Hide
        Hadoop QA added a comment -

        -1 overall. Here are the results of testing the latest attachment
        http://issues.apache.org/jira/secure/attachment/12634050/HDFS-6080.patch
        against trunk revision .

        +1 @author. The patch does not contain any @author tags.

        -1 tests included. The patch doesn't appear to include any new or modified tests.
        Please justify why no new tests are needed for this patch.
        Also please list what manual steps were performed to verify this patch.

        +1 javac. The applied patch does not increase the total number of javac compiler warnings.

        +1 javadoc. There were no new javadoc warning messages.

        +1 eclipse:eclipse. The patch built with eclipse:eclipse.

        -1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.

        +1 release audit. The applied patch does not increase the total number of release audit warnings.

        -1 core tests. The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs:

        org.apache.hadoop.fs.TestHdfsNativeCodeLoader
        org.apache.hadoop.hdfs.server.datanode.fsdataset.TestAvailableSpaceVolumeChoosingPolicy

        +1 contrib tests. The patch passed contrib unit tests.

        Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//testReport/
        Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html
        Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//console

        This message is automatically generated.

        Show
        Hadoop QA added a comment - -1 overall . Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12634050/HDFS-6080.patch against trunk revision . +1 @author . The patch does not contain any @author tags. -1 tests included . The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. +1 javac . The applied patch does not increase the total number of javac compiler warnings. +1 javadoc . There were no new javadoc warning messages. +1 eclipse:eclipse . The patch built with eclipse:eclipse. -1 findbugs . The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings. +1 release audit . The applied patch does not increase the total number of release audit warnings. -1 core tests . The patch failed these unit tests in hadoop-common-project/hadoop-nfs hadoop-hdfs-project/hadoop-hdfs hadoop-hdfs-project/hadoop-hdfs-nfs: org.apache.hadoop.fs.TestHdfsNativeCodeLoader org.apache.hadoop.hdfs.server.datanode.fsdataset.TestAvailableSpaceVolumeChoosingPolicy +1 contrib tests . The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//testReport/ Findbugs warnings: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//artifact/trunk/patchprocess/newPatchFindbugsWarningshadoop-hdfs-nfs.html Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/6377//console This message is automatically generated.
        Hide
        Brandon Li added a comment -

        +1

        Show
        Brandon Li added a comment - +1
        Hide
        Brandon Li added a comment -

        There are some format issues with the doc change. I've fixed them when committing the patch. Thank you, Abin, for the contribution!

        Show
        Brandon Li added a comment - There are some format issues with the doc change. I've fixed them when committing the patch. Thank you, Abin, for the contribution!
        Hide
        Brandon Li added a comment -

        Uploaded the committed patch.

        Show
        Brandon Li added a comment - Uploaded the committed patch.
        Brandon Li made changes -
        Attachment HDFS-6080.patch [ 12634547 ]
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-trunk-Commit #5323 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5323/)
        HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319)

        • /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-trunk-Commit #5323 (See https://builds.apache.org/job/Hadoop-trunk-Commit/5323/ ) HDFS-6080 . Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319 ) /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Brandon Li made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Brandon Li made changes -
        Fix Version/s 2.4.0 [ 12326143 ]
        Hide
        Hudson added a comment -

        FAILURE: Integrated in Hadoop-Yarn-trunk #509 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/509/)
        HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319)

        • /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - FAILURE: Integrated in Hadoop-Yarn-trunk #509 (See https://builds.apache.org/job/Hadoop-Yarn-trunk/509/ ) HDFS-6080 . Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319 ) /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Hdfs-trunk #1701 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1701/)
        HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319)

        • /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1701 (See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1701/ ) HDFS-6080 . Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319 ) /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1726 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1726/)
        HDFS-6080. Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319)

        • /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
        • /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Show
        Hudson added a comment - SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1726 (See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1726/ ) HDFS-6080 . Improve NFS gateway performance by making rtmax and wtmax configurable. Contributed by Abin Shahab (brandonli: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1577319 ) /hadoop/common/trunk/hadoop-common-project/hadoop-nfs/src/main/java/org/apache/hadoop/nfs/nfs3/Nfs3Constant.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/RpcProgramNfs3.java /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/site/apt/HdfsNfsGateway.apt.vm
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open In Progress In Progress
        46s 1 Abin Shahab 09/Mar/14 02:54
        In Progress In Progress Patch Available Patch Available
        3h 24m 1 Abin Shahab 09/Mar/14 06:18
        Patch Available Patch Available Resolved Resolved
        4d 14h 53m 1 Brandon Li 13/Mar/14 21:12
        Resolved Resolved Closed Closed
        27d 15h 59m 1 Arun C Murthy 10/Apr/14 14:11

          People

          • Assignee:
            Abin Shahab
            Reporter:
            Abin Shahab
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development