Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-14748

Make DataNodePeerMetrics#minOutlierDetectionSamples configurable

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.9.0, 3.0.0-alpha4
    • 3.3.0, 3.2.1, 3.1.3
    • None
    • None

    Description

      Slow node monitoring is to transfer 1000 packets between DataNodes within three hours before they are eligible to calculate and upload transmission delays to the namenode.
      But if Write data is very small and number of packets is less than 1000, the slow node will not be reported to NameNode, so make DataNodePeerMetrics#minOutlierDetectionSamplesconfigurable.

      Attachments

        1. HDFS-14748.001.patch
          10 kB
          Lisheng Sun
        2. HDFS-14748.002.patch
          10 kB
          Lisheng Sun
        3. HDFS-14748.003.patch
          11 kB
          Lisheng Sun

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HDFS-11194 Maintain aggregated peer performance metrics on NameNode

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #1314

          Activity

            People

              leosun08 Lisheng Sun
              leosun08 Lisheng Sun
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: