[KYLIN-1960] Provide a new build type called COVER

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Assignee: Zhong Yanghong
• Reporter: Zhong Yanghong
• Created: 16/Aug/16 08:43
• Updated: 29/Jun/20 04:16
• Resolved: 29/Jun/20 04:08

Description

The current three build types are not good at dealing with incremental building with refreshing old data.
For example, there are [S1, S2, S3] segments in a cube. S1 with time range [t1, t2); S2 with time range [t2, t3); S3 with time range [t3, t4).
Now users want to refresh the old data within [t2, t4). The current strategy is to merge S2 and S3 firstly. Then refresh the bigger segment with time range [t2, t4). The first step is meaningless and wasteful.
What if users want to build a new segment with time range [t2, t5), where t5 is larger than t4. The current strategy is clumsy.
How about providing a new build type? Here, it's called COVER. For this type, users also should provide start time and end time as parameters. The start time should match the boundaries of segments. In this case, it should be in set

{t1, t2, t3, t4}

. While the end time should be larger than t4, or match one of the end times of existing segments. In this case, it should be in set

{t2, t3, t4}

. Of course, the end time should be larger than the start time.
What job engine will do with this build type is as follows:
1. first build a new segment with the time range;
2. then the covered segments will be deleted.

Issue Links

• is related to: KYLIN-4550 Provide advanced refresh interface inside the refresh panel
• relates to: KYLIN-1900 Cube new build override old one