Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10645

Make block report size as a metric and add this metric to datanode web ui

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • datanode, ui
    • None
    • Reviewed

    Description

      Record block report size as a metric and show it on datanode UI. It's important for administrators to know the bottleneck of block report, and the metric is also a good tuning metric.

      Attachments

        1. HDFS-10645.001.patch
          8 kB
          Yuanbo Liu
        2. HDFS-10645.002.patch
          7 kB
          Yuanbo Liu
        3. HDFS-10645.003.patch
          7 kB
          Yuanbo Liu
        4. HDFS-10645.004.patch
          10 kB
          Yuanbo Liu
        5. HDFS-10645.005.patch
          12 kB
          Yuanbo Liu
        6. HDFS-10645.006.patch
          12 kB
          Yuanbo Liu
        7. HDFS-10645.007.patch
          11 kB
          Yuanbo Liu
        8. HDFS-10645.008.patch
          11 kB
          Yuanbo Liu
        9. HDFS-10645.009.patch
          11 kB
          Yuanbo Liu
        10. HDFS-10645-branch-2.001.patch
          11 kB
          Akira Ajisaka
        11. Selection_047.png
          14 kB
          Yuanbo Liu
        12. Selection_048.png
          15 kB
          Yuanbo Liu

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10612 Optimize mechanism when block report size exceed the limit of PB message

          • Major - Major loss of function.
          • Open

          Activity

            People

              yuanbo Yuanbo Liu
              yuanbo Yuanbo Liu
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: