Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-25632

Document suggested settings for PressureAwareCompactionThroughputController

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 2.3.0
    • None
    • Compaction, documentation
    • None

    Description

      After upgrading a cluster to 2.3, we noticed that compactions were taking much longer. We tracked this down to the PressureAwareCompactionThroughputController, which became default as part of our upgrade. Our default configuration settings set the lower bound: 50MB/s, upper bound: 100MB/s. These settings make sense if you have a 1gbit NIC (~120 MB/s). For a 10gbit NIC, they’re quite inadequate.

      Let's document this component explicitly and mention it as a call-out in the section on upgrading. Bonus points if we can provide suggested configuration values for the common networking configurations.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue HBASE-21284 Forward port HBASE-21000 to branch-2

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-25633 When unconfigured, PressureAwareCompactionThroughputController should sniff NIC speed and use appropriate settings

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              ndimiduk Nick Dimiduk
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: