Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7491

Add incremental blockreport latency to DN metrics

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.7.0
    • Component/s: datanode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      In a busy cluster, IBR processing could be delayed due to NN FSNamesystem lock and cause NN to throw NotReplicatedYetException to DFSClient and thus increase the overall application latency.

      This will be taken care of when we address the NN FSNamesystem lock contention issue.

      It is useful if we can provide IBR latency metrics from DN's point of view.

        Attachments

        1. HDFS-7491.patch
          3 kB
          Ming Ma
        2. HDFS-7491-2.patch
          3 kB
          Ming Ma
        3. HDFS-7491-3.patch
          4 kB
          Ming Ma
        4. HDFS-7491-4.patch
          4 kB
          Ming Ma
        5. HDFS-7491-branch-2.patch
          4 kB
          Ming Ma

          Activity

            People

            • Assignee:
              mingma Ming Ma
              Reporter:
              mingma Ming Ma
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: