[CARBONDATA-4034] Improve the time-consuming of Horizontal Compaction for update

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Resolved
• Fix Version/s: 2.1.0
• Assignee: Unassigned
• Reporter: Jiayu Shen
• Created: 15/Oct/20 12:38
• Updated: 17/Mar/21 03:15
• Resolved: 19/Nov/20 03:25

Description

In the update flow, horizontal compaction will be significantly slower when updating with a lot of segments(or a lot of blocks). There is a case whose costing is as shown in the log.

2020-10-10 09:38:10,466 | INFO | [OperationManager-Background-Pool-28] | Horizontal Update Compaction operation started for [ods_oms.oms_wh_outbound_order] 
 2020-10-10 09:50:25,718 | INFO | [OperationManager-Background-Pool-28] | Horizontal Update Compaction operation completed for [ods_oms.oms_wh_outbound_order]. 
 2020-10-10 10:15:44,302 | INFO | [OperationManager-Background-Pool-28] | Horizontal Delete Compaction operation started for [ods_oms.oms_wh_outbound_order] 
 2020-10-10 10:15:54,874 | INFO | [OperationManager-Background-Pool-28] | Horizontal Delete Compaction operation completed for [ods_oms.oms_wh_outbound_order].

In this PR, we optimize the process between second and third row of the log, by optimizing the method performDeleteDeltaCompaction in horizontal compaction flow.