Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16423

Add re-compare option to VerifyReplication to avoid occasional inconsistent rows

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.0.0
    • Fix Version/s: 1.4.0, 2.0.0
    • Component/s: Replication
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Because replication keeps eventually consistency, VerifyReplication may report inconsistent rows if there are data being written to source or peer clusters during scanning. These occasionally inconsistent rows will have the same data if we do the comparison again after a short period. It is not easy to find the really inconsistent rows if VerifyReplication report a large number of such occasionally inconsistency. To avoid this case, we can add an option to make VerifyReplication read out the inconsistent rows again after sleeping a few seconds and re-compare the rows during scanning. This behavior follows the eventually consistency of hbase's replication. Suggestions and discussions are welcomed.

        Attachments

        1. HBASE-16423-branch-1-v1.patch
          6 kB
          Jianwei Cui
        2. HBASE-16423-v3.patch
          8 kB
          Jianwei Cui
        3. HBASE-16423-v2.patch
          7 kB
          Jianwei Cui
        4. HBASE-16423-v1.patch
          8 kB
          Jianwei Cui

          Activity

            People

            • Assignee:
              cuijianwei Jianwei Cui
              Reporter:
              cuijianwei Jianwei Cui
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: