Details

    • Type: Sub-task Sub-task
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.2.0
    • Fix Version/s: 1.2.0
    • Component/s: datanode, namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".


      Please see hdfs-default.xml documentation corresponding to "dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
      Show
      This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval". Please see hdfs-default.xml documentation corresponding to "dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.

      Description

      Backport HDFS-4059 to branch-1.

        Issue Links

          Activity

          Jing Zhao created issue -
          Jing Zhao made changes -
          Field Original Value New Value
          Fix Version/s 1.1.0 [ 12317959 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Jing Zhao made changes -
          Component/s data-node [ 12312927 ]
          Component/s name-node [ 12312926 ]
          Hide
          Jing Zhao added a comment -

          To avoid bringing extra complexity to TestNameNodeMetrics when changing the number of stale nodes in MiniDFSCluster test, I put the test in TestReplicationPolicy.

          Show
          Jing Zhao added a comment - To avoid bringing extra complexity to TestNameNodeMetrics when changing the number of stale nodes in MiniDFSCluster test, I put the test in TestReplicationPolicy.
          Jing Zhao made changes -
          Attachment HDFS-4059-backport-branch-1.001.patch [ 12549538 ]
          Hide
          Matt Foley added a comment -

          Moved "to be fixed in" versions from fixVersion to targetVersion.
          Also, since 1.1.0 has been released without this change, set target to 1.1.1 instead.

          Show
          Matt Foley added a comment - Moved "to be fixed in" versions from fixVersion to targetVersion. Also, since 1.1.0 has been released without this change, set target to 1.1.1 instead.
          Matt Foley made changes -
          Fix Version/s 1.1.0 [ 12317959 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.0.3-alpha [ 12323274 ]
          Target Version/s 1.1.1, 3.0.0, 2.0.3-alpha [ 12321656, 12320356, 12323274 ]
          Hide
          Suresh Srinivas added a comment -

          Jing, can you run test-patch for this patch and post the results.

          Show
          Suresh Srinivas added a comment - Jing, can you run test-patch for this patch and post the results.
          Suresh Srinivas made changes -
          Link This issue is related to HDFS-4059 [ HDFS-4059 ]
          Hide
          Suresh Srinivas added a comment -

          This jira is ports HDFS-4059 to branch-1.

          Show
          Suresh Srinivas added a comment - This jira is ports HDFS-4059 to branch-1.
          Hide
          Suresh Srinivas added a comment -

          Here test-patch result:
          -1 overall.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 3 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          -1 findbugs. The patch appears to introduce 9 new Findbugs (version 1.3.9) warnings.

          Findbugs are not related to this. test-patch for branch-1 seems to be broken.

          Show
          Suresh Srinivas added a comment - Here test-patch result: -1 overall. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 3 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. -1 findbugs. The patch appears to introduce 9 new Findbugs (version 1.3.9) warnings. Findbugs are not related to this. test-patch for branch-1 seems to be broken.
          Hide
          Suresh Srinivas added a comment -

          I committed the patch to branch-1. Thank you Jing.

          Show
          Suresh Srinivas added a comment - I committed the patch to branch-1. Thank you Jing.
          Suresh Srinivas made changes -
          Release Note This jira adds a new metric with name "StaleDataNodes" under metrics context "dfs" of type Gauge. This tracks the number of DataNodes marked as stale. A DataNode is marked stale when the heartbeat message from the DataNode is not received within the configured time ""dfs.namenode.stale.datanode.interval".


          Please see hdfs-default.xml documentation corresponding to "dfs.namenode.stale.datanode.interval" for more details on how to configure this feature. When this feature is not configured, this metrics would return zero.
          Target Version/s 1.1.1, 3.0.0, 2.0.3-alpha [ 12321656, 12320356, 12323274 ] 1.1.1, 2.0.3-alpha [ 12321656, 12323274 ]
          Fix Version/s 1.2.0 [ 12321657 ]
          Resolution Fixed [ 1 ]
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Matt Foley made changes -
          Target Version/s 1.1.1, 2.0.3-alpha [ 12321656, 12323274 ] 1.2.0, 2.0.3-alpha [ 12321657, 12323274 ]
          Hide
          Matt Foley added a comment -

          Closed upon release of Hadoop 1.2.0.

          Show
          Matt Foley added a comment - Closed upon release of Hadoop 1.2.0.
          Matt Foley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Resolved Resolved
          1d 2h 54m 1 Suresh Srinivas 18/Oct/12 21:50
          Resolved Resolved Closed Closed
          208d 8h 25m 1 Matt Foley 15/May/13 06:16

            People

            • Assignee:
              Jing Zhao
              Reporter:
              Jing Zhao
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development