Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-16450

Shell tool to dump replication queues

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.3.0, 1.1.5, 1.2.2, 2.0.0
    • 1.3.0, 0.98.24, 2.0.0
    • Operability, Replication
    • None
    • Hide
      New tool to dump existing replication peers, configurations and queues when using HBase Replication.

      hbase org.apache.hadoop.hbase.replication.regionserver.DumpReplicationQueues

      The tool provides two flags:

       --distributed This flag will poll each RS for information about the replication queues being processed on this RS.
      By default this is not enabled and the information about the replication queues and configuration will be obtained from ZooKeeper.
       --hdfs When --distributed is used, this flag will attempt to calculate the total size of the WAL files used by the replication queues. Since its possible that multiple peers can be configured this value can be overestimated.
      Show
      New tool to dump existing replication peers, configurations and queues when using HBase Replication. hbase org.apache.hadoop.hbase.replication.regionserver.DumpReplicationQueues The tool provides two flags:  --distributed This flag will poll each RS for information about the replication queues being processed on this RS. By default this is not enabled and the information about the replication queues and configuration will be obtained from ZooKeeper.  --hdfs When --distributed is used, this flag will attempt to calculate the total size of the WAL files used by the replication queues. Since its possible that multiple peers can be configured this value can be overestimated.

    Description

      Currently there is no way to dump list of the configured queues and the replication queues when replication is enabled. Unfortunately the HBase master only offers an option to dump the whole content of the znodes but not details on the queues being processed on each RS.

      Attachments

        1. HBASE-16450.master.003.patch
          16 kB
          Esteban Gutierrez
        2. HBASE-16450.master.002.patch
          16 kB
          Esteban Gutierrez
        3. HBASE-16450.master.001.patch
          12 kB
          Esteban Gutierrez
        4. HBASE-16450.branch-1.002.patch
          17 kB
          Esteban Gutierrez
        5. HBASE-16450.branch-1.001.patch
          12 kB
          Esteban Gutierrez

        Activity

          People

            esteban Esteban Gutierrez
            esteban Esteban Gutierrez
            Votes:
            0 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: