Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14780

add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: hdfs
    • Labels:
      None

      Description

      I found SlowPeersReport in namenode's jmx is too simple, so i make an  inner class called org.apache.hadoop.hdfs.server.blockmanagement.SlowPeerTracker.ReportingNode to make SlowPeersReport's information more specific.Here is an example, the old SlowPeersReport maybe like this:

       

      "SlowPeersReport" :[{"SlowNode":"node4","ReportingNodes":["node1"]},{"SlowNode":"node2","ReportingNodes":["node1","node3"]},{"SlowNode":"node1","ReportingNodes":["node2"]}]

       

      we can see that the old SlowPeersReport just can tell you who is reporting the slownode, actually we can get more information by using the  inner class ReportingNode :

       

      "SlowPeersReport" :[{"SlowNode":"node4","ReportingNodes":[{"nodeId":"node1","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]},{"SlowNode":"node2","ReportingNodes":[{"nodeId":"node1","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"},{"nodeId":"node3","averageDelay":1000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]},{"SlowNode":"node1","ReportingNodes":[{"nodeId":"node2","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]}]

       

      we can know the averageDelay of reportingnode sending packet to slownode, and the reportTime can tell us when this message reporting to namenode.I think these message will be helpful for us to analyze the slownode problem.

        Attachments

        1. HDFS-14780
          16 kB
          Haibin Huang
        2. HDFS-14780.001.patch
          18 kB
          Haibin Huang

          Activity

            People

            • Assignee:
              huanghaibin Haibin Huang
              Reporter:
              huanghaibin Haibin Huang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: