Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Invalid
-
None
-
None
-
None
Description
HBase provides hbase.hregion.majorcompaction
Time between major compactions, expressed in milliseconds. Set to 0 to disable time-based automatic major compactions. User-requested and size-based major compactions will still run. This value is multiplied by hbase.hregion.majorcompaction.jitter to cause compaction to start at a somewhat-random time during a given window of time. The default value is 7 days, expressed in milliseconds. If major compactions are causing disruption in your environment, you can configure them to run at off-peak times for your deployment, or disable time-based major compactions by setting this parameter to 0, and run major compactions in a cron job or by another external mechanism.
Instead of this existing mechanism, that adds randomness into a production system (ugh), let's simply allow users to specify a cron string and replace this simple periodic (+jitter) scheduling mechanism. CRON is useful for systems that have known windows of time (i.e. weekend, nights) that are known to be good times for compaction.
Attachments
Issue Links
- is related to
-
HBASE-3743 Throttle major compaction
- Closed