Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2234

Roll Hlog if any datanode in the write pipeline dies

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.90.0
    • Component/s: regionserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HDFS does not replicate the last block of a file that is being written to. This means that is datanodes in the write pipeline die, then the data blocks in the transaction log would be experiencing reduced redundancy. It would be good if the region server can detect datanode-death in the write pipeline while writing to the transaction log and if this happens, close the current log an open a new one. This depends on HDFS-826

        Attachments

        1. HBASE-2234-20.4-1.patch
          16 kB
          Nicolas Spiegelberg
        2. HBASE-2234-20.4.patch
          15 kB
          Nicolas Spiegelberg

          Issue Links

            Activity

              People

              • Assignee:
                nspiegelberg Nicolas Spiegelberg
                Reporter:
                dhruba dhruba borthakur
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: