Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16450

Shell tool to dump replication queues

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 1.1.5, 1.2.2, 2.0.0
    • Fix Version/s: 1.3.0, 0.98.24, 2.0.0
    • Component/s: Operability, Replication
    • Labels:
      None
    • Release Note:
      Hide
      New tool to dump existing replication peers, configurations and queues when using HBase Replication.

      hbase org.apache.hadoop.hbase.replication.regionserver.DumpReplicationQueues

      The tool provides two flags:

       --distributed This flag will poll each RS for information about the replication queues being processed on this RS.
      By default this is not enabled and the information about the replication queues and configuration will be obtained from ZooKeeper.
       --hdfs When --distributed is used, this flag will attempt to calculate the total size of the WAL files used by the replication queues. Since its possible that multiple peers can be configured this value can be overestimated.
      Show
      New tool to dump existing replication peers, configurations and queues when using HBase Replication. hbase org.apache.hadoop.hbase.replication.regionserver.DumpReplicationQueues The tool provides two flags:  --distributed This flag will poll each RS for information about the replication queues being processed on this RS. By default this is not enabled and the information about the replication queues and configuration will be obtained from ZooKeeper.  --hdfs When --distributed is used, this flag will attempt to calculate the total size of the WAL files used by the replication queues. Since its possible that multiple peers can be configured this value can be overestimated.

      Description

      Currently there is no way to dump list of the configured queues and the replication queues when replication is enabled. Unfortunately the HBase master only offers an option to dump the whole content of the znodes but not details on the queues being processed on each RS.

        Attachments

        1. HBASE-16450.master.003.patch
          16 kB
          Esteban Gutierrez
        2. HBASE-16450.master.002.patch
          16 kB
          Esteban Gutierrez
        3. HBASE-16450.master.001.patch
          12 kB
          Esteban Gutierrez
        4. HBASE-16450.branch-1.002.patch
          17 kB
          Esteban Gutierrez
        5. HBASE-16450.branch-1.001.patch
          12 kB
          Esteban Gutierrez

          Activity

            People

            • Assignee:
              esteban Esteban Gutierrez
              Reporter:
              esteban Esteban Gutierrez
            • Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: