Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2972

HA: small optimization building incremental block report

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: HA branch (HDFS-1623)
    • Fix Version/s: HA branch (HDFS-1623)
    • Component/s: datanode, ha
    • Labels:
      None

      Description

      Current the incremental block report is a List. However, we only really need to send the most recent information for each block. So, if a block becomes RBW and is then becomes FINALIZED before the next incremental block report, we should just report the FINALIZED replica. It's an easy change to just switch to a map by blockid.
      This is on the HA branch since HA changes the code to send RBWs in the incremental reports, hence it's more important for maintaining performance parity with trunk.

        Attachments

        1. hdfs-2972.txt
          8 kB
          Todd Lipcon

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: