Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1623 High Availability Framework for HDFS NN
  3. HDFS-2972

HA: small optimization building incremental block report

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • HA branch (HDFS-1623)
    • HA branch (HDFS-1623)
    • datanode, ha
    • None

    Description

      Current the incremental block report is a List. However, we only really need to send the most recent information for each block. So, if a block becomes RBW and is then becomes FINALIZED before the next incremental block report, we should just report the FINALIZED replica. It's an easy change to just switch to a map by blockid.
      This is on the HA branch since HA changes the code to send RBWs in the incremental reports, hence it's more important for maintaining performance parity with trunk.

      Attachments

        1. hdfs-2972.txt
          8 kB
          Todd Lipcon

        Activity

          People

            tlipcon Todd Lipcon
            tlipcon Todd Lipcon
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: