Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7491

Add incremental blockreport latency to DN metrics

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 2.7.0
    • datanode
    • None
    • Reviewed

    Description

      In a busy cluster, IBR processing could be delayed due to NN FSNamesystem lock and cause NN to throw NotReplicatedYetException to DFSClient and thus increase the overall application latency.

      This will be taken care of when we address the NN FSNamesystem lock contention issue.

      It is useful if we can provide IBR latency metrics from DN's point of view.

      Attachments

        1. HDFS-7491-branch-2.patch
          4 kB
          Ming Ma
        2. HDFS-7491-4.patch
          4 kB
          Ming Ma
        3. HDFS-7491-3.patch
          4 kB
          Ming Ma
        4. HDFS-7491-2.patch
          3 kB
          Ming Ma
        5. HDFS-7491.patch
          3 kB
          Ming Ma

        Activity

          People

            mingma Ming Ma
            mingma Ming Ma
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: