Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12198

Document missing namenode metrics that were added recently

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 3.0.0-alpha4
    • Fix Version/s: 2.9.0, 3.0.0-beta1
    • Component/s: documentation
    • Labels:
      None

      Description

      There are some namenode metrics added recently but haven't been documented in Metrics.md. Totally following metrics and related JIRAs:

      HDFS-12043:

        @Metric ("Number of successful re-replications")
         MutableCounterLong successfulReReplications;
         @Metric ("Number of times we failed to schedule a block re-replication.")
         MutableCounterLong numTimesReReplicationNotScheduled;
         @Metric("Number of timed out block re-replications")
        MutableCounterLong timeoutReReplications;
      

      HDFS-11907:

      @Metric("Resource check time") private MutableRate resourceCheckTime;
      private final MutableQuantiles[] resourceCheckTimeQuantiles;
       

      HADOOP-14502:

      @Metric("Number of blockReports from individual storages")
       final MutableRate storageBlockReport;
       final MutableQuantiles[] storageBlockReportQuantiles;
      
      1. HDFS-12198.001.patch
        3 kB
        Yiqun Lin
      2. HDFS-12198-branch-2.001.patch
        2 kB
        Yiqun Lin

        Activity

        Hide
        linyiqun Yiqun Lin added a comment -

        Committed to branch-2. Thanks Akira Ajisaka for providing the review.

        Show
        linyiqun Yiqun Lin added a comment - Committed to branch-2. Thanks Akira Ajisaka for providing the review.
        Hide
        linyiqun Yiqun Lin added a comment -

        Thanks for the review, Akira Ajisaka, I will commit this shortly.

        Show
        linyiqun Yiqun Lin added a comment - Thanks for the review, Akira Ajisaka , I will commit this shortly.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1, thanks Yiqun.

        Show
        ajisakaa Akira Ajisaka added a comment - +1, thanks Yiqun.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 19s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
              branch-2 Compile Tests
        +1 mvninstall 7m 3s branch-2 passed
        +1 mvnsite 0m 58s branch-2 passed
              Patch Compile Tests
        +1 mvnsite 0m 56s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
              Other Tests
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        9m 51s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:5e40efe
        JIRA Issue HDFS-12198
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880629/HDFS-12198-branch-2.001.patch
        Optional Tests asflicense mvnsite
        uname Linux a46c0b2edc33 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision branch-2 / cfdf297
        modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20579/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 19s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       branch-2 Compile Tests +1 mvninstall 7m 3s branch-2 passed +1 mvnsite 0m 58s branch-2 passed       Patch Compile Tests +1 mvnsite 0m 56s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues.       Other Tests +1 asflicense 0m 17s The patch does not generate ASF License warnings. 9m 51s Subsystem Report/Notes Docker Image:yetus/hadoop:5e40efe JIRA Issue HDFS-12198 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12880629/HDFS-12198-branch-2.001.patch Optional Tests asflicense mvnsite uname Linux a46c0b2edc33 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision branch-2 / cfdf297 modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20579/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        linyiqun Yiqun Lin added a comment - - edited

        Thanks Akira Ajisaka, attach the patch for branch-2. I noticed one thing that HADOOP-14502 didn't committed in branch-2. So I only added related metrics of other two JIRAs and missing block report MutableQuantiles metric in patch.

        Show
        linyiqun Yiqun Lin added a comment - - edited Thanks Akira Ajisaka , attach the patch for branch-2. I noticed one thing that HADOOP-14502 didn't committed in branch-2. So I only added related metrics of other two JIRAs and missing block report MutableQuantiles metric in patch.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        Committed this to trunk.

        Show
        ajisakaa Akira Ajisaka added a comment - Committed this to trunk.
        Hide
        ajisakaa Akira Ajisaka added a comment -

        +1, committing to trunk. Hi Yiqun Lin, would you create a patch for branch-2?

        Show
        ajisakaa Akira Ajisaka added a comment - +1, committing to trunk. Hi Yiqun Lin , would you create a patch for branch-2?
        Hide
        linyiqun Yiqun Lin added a comment -

        Hi Akira Ajisaka, could you please help review on this? Thanks in advance.

        Show
        linyiqun Yiqun Lin added a comment - Hi Akira Ajisaka , could you please help review on this? Thanks in advance.
        Hide
        hadoopqa Hadoop QA added a comment -
        +1 overall



        Vote Subsystem Runtime Comment
        0 reexec 0m 12s Docker mode activated.
              Prechecks
        +1 @author 0m 0s The patch does not contain any @author tags.
              trunk Compile Tests
        +1 mvninstall 13m 22s trunk passed
        +1 mvnsite 1m 22s trunk passed
              Patch Compile Tests
        +1 mvnsite 1m 14s the patch passed
        +1 whitespace 0m 0s The patch has no whitespace issues.
              Other Tests
        +1 asflicense 0m 17s The patch does not generate ASF License warnings.
        16m 45s



        Subsystem Report/Notes
        Docker Image:yetus/hadoop:14b5c93
        JIRA Issue HDFS-12198
        JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879282/HDFS-12198.001.patch
        Optional Tests asflicense mvnsite
        uname Linux 3d23afa33fbc 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        Build tool maven
        Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh
        git revision trunk / 38c6fa5
        modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common
        Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20458/console
        Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org

        This message was automatically generated.

        Show
        hadoopqa Hadoop QA added a comment - +1 overall Vote Subsystem Runtime Comment 0 reexec 0m 12s Docker mode activated.       Prechecks +1 @author 0m 0s The patch does not contain any @author tags.       trunk Compile Tests +1 mvninstall 13m 22s trunk passed +1 mvnsite 1m 22s trunk passed       Patch Compile Tests +1 mvnsite 1m 14s the patch passed +1 whitespace 0m 0s The patch has no whitespace issues.       Other Tests +1 asflicense 0m 17s The patch does not generate ASF License warnings. 16m 45s Subsystem Report/Notes Docker Image:yetus/hadoop:14b5c93 JIRA Issue HDFS-12198 JIRA Patch URL https://issues.apache.org/jira/secure/attachment/12879282/HDFS-12198.001.patch Optional Tests asflicense mvnsite uname Linux 3d23afa33fbc 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux Build tool maven Personality /testptch/hadoop/patchprocess/precommit/personality/provided.sh git revision trunk / 38c6fa5 modules C: hadoop-common-project/hadoop-common U: hadoop-common-project/hadoop-common Console output https://builds.apache.org/job/PreCommit-HDFS-Build/20458/console Powered by Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org This message was automatically generated.
        Hide
        linyiqun Yiqun Lin added a comment -

        Attach the patch. Kindly review.

        Show
        linyiqun Yiqun Lin added a comment - Attach the patch. Kindly review.

          People

          • Assignee:
            linyiqun Yiqun Lin
            Reporter:
            linyiqun Yiqun Lin
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development