Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
MIN_HISTORY_LEVEL table is used in two places:
- Cleaner uses it to decide if the files can be removed - this could be replaced by adding a new column to compaction_queue storing the next_txn_id when the change was committed, and before cleaning checking the minimum open transaction id in the TXNS table
- Initiator uses it to decide if some items from TXN_TO_WRITE_ID table can be removed. This could be replaced by using the WRITE_SET.WS_COMMIT_ID.
Attachments
Attachments
Issue Links
- is fixed by
-
HIVE-24291 Compaction Cleaner prematurely cleans up deltas
-
- Closed
-
-
HIVE-24403 change min_history_level schema change to be compatible with previous version
-
- Closed
-
- links to