HBase
  1. HBase
  2. HBASE-2234

Roll Hlog if any datanode in the write pipeline dies

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.90.0
    • Component/s: regionserver
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      HDFS does not replicate the last block of a file that is being written to. This means that is datanodes in the write pipeline die, then the data blocks in the transaction log would be experiencing reduced redundancy. It would be good if the region server can detect datanode-death in the write pipeline while writing to the transaction log and if this happens, close the current log an open a new one. This depends on HDFS-826

      1. HBASE-2234-20.4.patch
        15 kB
        Nicolas Spiegelberg
      2. HBASE-2234-20.4-1.patch
        16 kB
        Nicolas Spiegelberg

        Issue Links

          Activity

          dhruba borthakur created issue -
          dhruba borthakur made changes -
          Field Original Value New Value
          Link This issue is blocked by HDFS-826 [ HDFS-826 ]
          stack made changes -
          Assignee stack [ stack ]
          stack made changes -
          Fix Version/s 0.20.4 [ 12314496 ]
          Fix Version/s 0.21.0 [ 12313607 ]
          Nicolas Spiegelberg made changes -
          Attachment HBASE-2234-20.4.patch [ 12437290 ]
          Nicolas Spiegelberg made changes -
          Link This issue incorporates HBASE-1939 [ HBASE-1939 ]
          Nicolas Spiegelberg made changes -
          Attachment HBASE-2234-20.4-1.patch [ 12437960 ]
          Nicolas Spiegelberg made changes -
          Attachment HBASE-2234-20.4-1.patch [ 12437961 ]
          Nicolas Spiegelberg made changes -
          Attachment HBASE-2234-20.4-1.patch [ 12437960 ]
          stack made changes -
          Assignee stack [ stack ] Nicolas Spiegelberg [ nspiegelberg ]
          stack made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          stack made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Fix Version/s 0.21.0 [ 12313607 ]
          Resolution Fixed [ 1 ]
          stack made changes -
          Fix Version/s 0.20.5 [ 12314800 ]
          Fix Version/s 0.20.4 [ 12314496 ]
          stack made changes -
          Fix Version/s 0.21.0 [ 12313607 ]
          Fix Version/s 0.20.5 [ 12314800 ]

            People

            • Assignee:
              Nicolas Spiegelberg
              Reporter:
              dhruba borthakur
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development