Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-19646

Add CRON To Major Compaction

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Invalid
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Compaction
    • Labels:
      None

      Description

      HBase provides hbase.hregion.majorcompaction

      Time between major compactions, expressed in milliseconds. Set to 0 to disable time-based automatic major compactions. User-requested and size-based major compactions will still run. This value is multiplied by hbase.hregion.majorcompaction.jitter to cause compaction to start at a somewhat-random time during a given window of time. The default value is 7 days, expressed in milliseconds. If major compactions are causing disruption in your environment, you can configure them to run at off-peak times for your deployment, or disable time-based major compactions by setting this parameter to 0, and run major compactions in a cron job or by another external mechanism.

      Instead of this existing mechanism, that adds randomness into a production system (ugh), let's simply allow users to specify a cron string and replace this simple periodic (+jitter) scheduling mechanism. CRON is useful for systems that have known windows of time (i.e. weekend, nights) that are known to be good times for compaction.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                belugabehr David Mollitor
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: