Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16466

HBase snapshots support in VerifyReplication tool to reduce load on live HBase cluster with large tables

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.98.21
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None
    • Release Note:
      Hide
      Support for snapshots in VerifyReplication tool i.e. verifyrep can compare source table snapshot against peer table snapshot which reduces load on RS by reading data from HDFS directly using Snapshot scanners.
      Instead of comparing against live tables whose state changes due to writes and compactions its better to compare HBase snapshots which are immutable in nature.
      Show
      Support for snapshots in VerifyReplication tool i.e. verifyrep can compare source table snapshot against peer table snapshot which reduces load on RS by reading data from HDFS directly using Snapshot scanners. Instead of comparing against live tables whose state changes due to writes and compactions its better to compare HBase snapshots which are immutable in nature.

      Description

      As of now VerifyReplicatin tool is running using normal HBase scanners. If you want to run VerifyReplication multiple times on a production live cluster with large tables then it creates extra load on HBase layer. So if we implement snapshot based support then both in source and target we can read data from snapshots which reduces load on HBase

        Attachments

        1. HBASE-16466.branch-1.3.001.patch
          26 kB
          Maddineni Sukumar
        2. HBASE-16466.v1.patch
          28 kB
          Maddineni Sukumar
        3. HBASE-16466.v2.patch
          46 kB
          Maddineni Sukumar
        4. HBASE-16466.v3.patch
          28 kB
          Maddineni Sukumar
        5. HBASE-16466.v4.patch
          28 kB
          Maddineni Sukumar
        6. HBASE-16466.v5.patch
          25 kB
          Maddineni Sukumar

          Issue Links

            Activity

              People

              • Assignee:
                sukunaidu@gmail.com Maddineni Sukumar
                Reporter:
                sukumaddineni Sukumar Maddineni
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: