Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6758

[replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I have seen cases where the replication-executor would lose data to replicate since the file hasn't been closed yet. Upon closing, the new data becomes visible. Before that happens the ZK node shouldn't be deleted in ReplicationSourceManager.logPositionAndCleanOldLogs. Changes need to be made in ReplicationSource.processEndOfFile as well (currentPath related).

        Attachments

        1. 6758-0.94.txt
          9 kB
          Lars Hofhansl
        2. 6758-1-0.92.patch
          13 kB
          Devaraj Das
        3. 6758-2-0.92.patch
          18 kB
          Devaraj Das
        4. 6758-trunk-1.patch
          20 kB
          Devaraj Das
        5. 6758-trunk-2.patch
          3 kB
          Devaraj Das
        6. 6758-trunk-3.patch
          9 kB
          Devaraj Das
        7. 6758-trunk-4.patch
          9 kB
          Devaraj Das
        8. TEST-org.apache.hadoop.hbase.replication.TestReplication.xml
          2.78 MB
          Ted Yu

          Issue Links

            Activity

              People

              • Assignee:
                devaraj Devaraj Das
                Reporter:
                devaraj Devaraj Das
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: