Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-11442

ReplicationSourceManager doesn't cleanup the queues for recovered sources

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.99.0, 0.98.4
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, ReplicationSourceManager only cleanups the queues for recovered sources when the queue is being closed. This can cause the already read WAL's files to be read again when a region server doing failover also dies. This can cause replication to possibly happen again

      For e.g lets say RS1 dies with 5 files in queue and RS2 is doing the failover. Now, lets say RS2 dies after going thru 3 files in queue and RS3 is doing the failover. In this case, RS3 will again read those 3 files as they were not removed from the queue. (Though it will read the first file from the set pos. in ZK)

        Attachments

        1. HBASE-11442.patch
          10 kB
          Virag Kothari
        2. HBASE-11442_2.patch
          10 kB
          Virag Kothari

          Activity

            People

            • Assignee:
              virag Virag Kothari
              Reporter:
              virag Virag Kothari
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: