Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9889

Update balancer/mover document about HDFS-6133 feature

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha1
    • Fix Version/s: 2.8.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    1. HDFS-9889.001.patch
      2 kB
      Yongjun Zhang
    2. HDFS-9889.002.patch
      2 kB
      Yongjun Zhang

      Issue Links

        Activity

        Hide
        yzhangal Yongjun Zhang added a comment -

        Uploaded patch rev 001.

        Show
        yzhangal Yongjun Zhang added a comment - Uploaded patch rev 001.
        Hide
        andrew.wang Andrew Wang added a comment -

        Hey Yongjun, I think the config key you mention is incorrect. HDFS-6133 added "dfs.datanode.block-pinning.enabled" which on the DN side. Might also want to clarify that this only applies to blocks written via the "favored nodes" option.

        Show
        andrew.wang Andrew Wang added a comment - Hey Yongjun, I think the config key you mention is incorrect. HDFS-6133 added "dfs.datanode.block-pinning.enabled" which on the DN side. Might also want to clarify that this only applies to blocks written via the "favored nodes" option.
        Hide
        yzhangal Yongjun Zhang added a comment -

        Oh silly me, thanks Andrew Wang!

        I was trapped by the order of patches in HDFS-6133, I thought rev 9 (the last one in the list) is the one committed, actually it's rev 10 which showed up earlier in the list rather than the last.. Three digits is recommended to represent patch rev number, however, the key is that I should have examined in the committed source code.

        Thanks again. New rev to come soon.

        Show
        yzhangal Yongjun Zhang added a comment - Oh silly me, thanks Andrew Wang ! I was trapped by the order of patches in HDFS-6133 , I thought rev 9 (the last one in the list) is the one committed, actually it's rev 10 which showed up earlier in the list rather than the last.. Three digits is recommended to represent patch rev number, however, the key is that I should have examined in the committed source code. Thanks again. New rev to come soon.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 15s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 6m 51s trunk passed
        +1 mvnsite 0m 53s trunk passed
        +1 mvnsite 0m 52s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 19s Patch does not generate ASF License warnings.
        9m 26s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:0ca8df7
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791003/HDFS-9889.001.patch
        JIRA Issue HDFS-9889
        Optional Tests asflicense mvnsite
        uname Linux 18b3c8eb7616 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 67880cc
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14692/console
        Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 15s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 6m 51s trunk passed +1 mvnsite 0m 53s trunk passed +1 mvnsite 0m 52s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 19s Patch does not generate ASF License warnings. 9m 26s Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791003/HDFS-9889.001.patch JIRA Issue HDFS-9889 Optional Tests asflicense mvnsite uname Linux 18b3c8eb7616 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 67880cc modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14692/console Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        yzhangal Yongjun Zhang added a comment -

        Hi Andrew Wang, I uploaded rev 002 to address your comments, would you please help taking a look? thanks.

        Show
        yzhangal Yongjun Zhang added a comment - Hi Andrew Wang , I uploaded rev 002 to address your comments, would you please help taking a look? thanks.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 20s Docker mode activated.
        +1 @author 0m 0s The patch does not contain any @author tags.
        +1 mvninstall 6m 44s trunk passed
        +1 mvnsite 0m 52s trunk passed
        +1 mvnsite 0m 49s the patch passed
        +1 whitespace 0m 0s Patch has no whitespace issues.
        +1 asflicense 0m 17s Patch does not generate ASF License warnings.
        9m 17s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:0ca8df7
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791018/HDFS-9889.002.patch
        JIRA Issue HDFS-9889
        Optional Tests asflicense mvnsite
        uname Linux 8f29321b1ae9 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 67880cc
        modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14695/console
        Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 20s Docker mode activated. +1 @author 0m 0s The patch does not contain any @author tags. +1 mvninstall 6m 44s trunk passed +1 mvnsite 0m 52s trunk passed +1 mvnsite 0m 49s the patch passed +1 whitespace 0m 0s Patch has no whitespace issues. +1 asflicense 0m 17s Patch does not generate ASF License warnings. 9m 17s Subsystem Report/Notes Docker Image:yetus/hadoop:0ca8df7 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12791018/HDFS-9889.002.patch JIRA Issue HDFS-9889 Optional Tests asflicense mvnsite uname Linux 8f29321b1ae9 3.13.0-36-lowlatency #63-Ubuntu SMP PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 67880cc modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs Console output https://builds.apache.org/job/PreCommit-HDFS-Build/14695/console Powered by Apache Yetus 0.3.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        andrew.wang Andrew Wang added a comment -

        +1 LGTM, thanks Yongjun!

        Show
        andrew.wang Andrew Wang added a comment - +1 LGTM, thanks Yongjun!
        Hide
        yzhangal Yongjun Zhang added a comment - - edited

        Committed to trunk, branch-2, and branch-2.8.

        Thanks Andrew Wang for the review!

        Show
        yzhangal Yongjun Zhang added a comment - - edited Committed to trunk, branch-2, and branch-2.8. Thanks Andrew Wang for the review!
        Hide
        hudson Hudson added a comment -

        FAILURE: Integrated in Hadoop-trunk-Commit #9425 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9425/)
        HDFS-9889. Update balancer/mover document about HDFS-6133 feature. (yzhang: rev 8e08861a14cb5b6adce338543d7da08e9926ad46)

        • hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md
        Show
        hudson Hudson added a comment - FAILURE: Integrated in Hadoop-trunk-Commit #9425 (See https://builds.apache.org/job/Hadoop-trunk-Commit/9425/ ) HDFS-9889 . Update balancer/mover document about HDFS-6133 feature. (yzhang: rev 8e08861a14cb5b6adce338543d7da08e9926ad46) hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSCommands.md

          People

          • Assignee:
            yzhangal Yongjun Zhang
            Reporter:
            yzhangal Yongjun Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development