Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14780

add ReportingNode to make the information of SlowPeersReport in namenode's jmx more specific

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • hdfs
    • None

    Description

      I found SlowPeersReport in namenode's jmx is too simple, so i make an  inner class called org.apache.hadoop.hdfs.server.blockmanagement.SlowPeerTracker.ReportingNode to make SlowPeersReport's information more specific.Here is an example, the old SlowPeersReport maybe like this:

       

      "SlowPeersReport" :[{"SlowNode":"node4","ReportingNodes":["node1"]},{"SlowNode":"node2","ReportingNodes":["node1","node3"]},{"SlowNode":"node1","ReportingNodes":["node2"]}]

       

      we can see that the old SlowPeersReport just can tell you who is reporting the slownode, actually we can get more information by using the  inner class ReportingNode :

       

      "SlowPeersReport" :[{"SlowNode":"node4","ReportingNodes":[{"nodeId":"node1","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]},{"SlowNode":"node2","ReportingNodes":[{"nodeId":"node1","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"},{"nodeId":"node3","averageDelay":1000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]},{"SlowNode":"node1","ReportingNodes":[{"nodeId":"node2","averageDelay":2000.0,"reportTime":"Tue Aug 27 16:44:49 CST 2019"}]}]

       

      we can know the averageDelay of reportingnode sending packet to slownode, and the reportTime can tell us when this message reporting to namenode.I think these message will be helpful for us to analyze the slownode problem.

      Attachments

        1. HDFS-14780.001.patch
          18 kB
          Haibin Huang
        2. HDFS-14780
          16 kB
          Haibin Huang

        Activity

          People

            huanghaibin Haibin Huang
            huanghaibin Haibin Huang
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: