Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19646

Add CRON To Major Compaction

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Invalid
    • None
    • None
    • Compaction
    • None

    Description

      HBase provides hbase.hregion.majorcompaction

      Time between major compactions, expressed in milliseconds. Set to 0 to disable time-based automatic major compactions. User-requested and size-based major compactions will still run. This value is multiplied by hbase.hregion.majorcompaction.jitter to cause compaction to start at a somewhat-random time during a given window of time. The default value is 7 days, expressed in milliseconds. If major compactions are causing disruption in your environment, you can configure them to run at off-peak times for your deployment, or disable time-based major compactions by setting this parameter to 0, and run major compactions in a cron job or by another external mechanism.

      Instead of this existing mechanism, that adds randomness into a production system (ugh), let's simply allow users to specify a cron string and replace this simple periodic (+jitter) scheduling mechanism. CRON is useful for systems that have known windows of time (i.e. weekend, nights) that are known to be good times for compaction.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              belugabehr David Mollitor
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: