HBase
  1. HBase
  2. HBASE-6758

[replication] The replication-executor should make sure the file that it is replicating is closed before declaring success on that file

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.95.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I have seen cases where the replication-executor would lose data to replicate since the file hasn't been closed yet. Upon closing, the new data becomes visible. Before that happens the ZK node shouldn't be deleted in ReplicationSourceManager.logPositionAndCleanOldLogs. Changes need to be made in ReplicationSource.processEndOfFile as well (currentPath related).

      1. TEST-org.apache.hadoop.hbase.replication.TestReplication.xml
        2.78 MB
        Ted Yu
      2. 6758-trunk-4.patch
        9 kB
        Devaraj Das
      3. 6758-trunk-3.patch
        9 kB
        Devaraj Das
      4. 6758-trunk-2.patch
        3 kB
        Devaraj Das
      5. 6758-trunk-1.patch
        20 kB
        Devaraj Das
      6. 6758-2-0.92.patch
        18 kB
        Devaraj Das
      7. 6758-1-0.92.patch
        13 kB
        Devaraj Das
      8. 6758-0.94.txt
        9 kB
        Lars Hofhansl

        Issue Links

          Activity

          Devaraj Das created issue -
          Devaraj Das made changes -
          Field Original Value New Value
          Attachment 6758-1-0.92.patch [ 12545368 ]
          Devaraj Das made changes -
          Attachment 6758-2-0.92.patch [ 12545499 ]
          Ted Yu made changes -
          Devaraj Das made changes -
          Attachment 6758-trunk-1.patch [ 12546989 ]
          Devaraj Das made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          stack made changes -
          Priority Major [ 3 ] Critical [ 2 ]
          Devaraj Das made changes -
          Attachment 6758-trunk-2.patch [ 12547636 ]
          Devaraj Das made changes -
          Attachment 6758-trunk-3.patch [ 12547851 ]
          Devaraj Das made changes -
          Attachment 6758-trunk-4.patch [ 12548635 ]
          Jean-Daniel Cryans made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Resolution Fixed [ 1 ]
          Lars Hofhansl made changes -
          Attachment 6758-0.94.txt [ 12549769 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Devaraj Das made changes -
          Status Reopened [ 4 ] Resolved [ 5 ]
          Fix Version/s 0.94.3 [ 12323144 ]
          Resolution Fixed [ 1 ]
          Devaraj Das made changes -
          Link This issue relates to HBASE-7017 [ HBASE-7017 ]
          stack made changes -
          Fix Version/s 0.95.0 [ 12324094 ]
          Fix Version/s 0.96.0 [ 12320040 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          Lars Hofhansl made changes -
          Fix Version/s 0.94.3 [ 12323144 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          stack made changes -
          Fix Version/s 0.98.0 [ 12323143 ]
          stack made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Devaraj Das
              Reporter:
              Devaraj Das
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development