Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-2234

Roll Hlog if any datanode in the write pipeline dies

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.90.0
    • regionserver
    • None
    • Reviewed

    Description

      HDFS does not replicate the last block of a file that is being written to. This means that is datanodes in the write pipeline die, then the data blocks in the transaction log would be experiencing reduced redundancy. It would be good if the region server can detect datanode-death in the write pipeline while writing to the transaction log and if this happens, close the current log an open a new one. This depends on HDFS-826

      Attachments

        1. HBASE-2234-20.4.patch
          15 kB
          Nicolas Spiegelberg
        2. HBASE-2234-20.4-1.patch
          16 kB
          Nicolas Spiegelberg

        Issue Links

          incorporates

          New Feature - A new feature of the product, which has yet to be developed. HBASE-1939 HLog group commit

          • Major - Major loss of function.
          • Closed
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-826 Allow a mechanism for an application to detect that datanode(s) have died in the write pipeline

          • Major - Major loss of function.
          • Closed

          Activity

            People

              nspiegelberg Nicolas Spiegelberg
              dhruba Dhruba Borthakur
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: