Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6758

[replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I have seen cases where the replication-executor would lose data to replicate since the file hasn't been closed yet. Upon closing, the new data becomes visible. Before that happens the ZK node shouldn't be deleted in ReplicationSourceManager.logPositionAndCleanOldLogs. Changes need to be made in ReplicationSource.processEndOfFile as well (currentPath related).

        Attachments

        1. 6758-0.94.txt
          9 kB
          Lars Hofhansl
        2. 6758-1-0.92.patch
          13 kB
          Devaraj Das
        3. 6758-2-0.92.patch
          18 kB
          Devaraj Das
        4. 6758-trunk-1.patch
          20 kB
          Devaraj Das
        5. 6758-trunk-2.patch
          3 kB
          Devaraj Das
        6. 6758-trunk-3.patch
          9 kB
          Devaraj Das
        7. 6758-trunk-4.patch
          9 kB
          Devaraj Das
        8. TEST-org.apache.hadoop.hbase.replication.TestReplication.xml
          2.78 MB
          Ted Yu

          Issue Links

            Activity

              People

              • Assignee:
                ddas Devaraj Das
                Reporter:
                ddas Devaraj Das
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: