[KYLIN-2727] Introduce cube planner able to select cost-effective cuboids to be built by cost-based algorithms - ASF JIRA

XML

Word

Printable

JSON

There're several disadvantages to create partial cubes only based on static rules:

To learn the concept of these rules will bring extra burden to cube admins
To achieve a goal cuboid set may need a very complicated set of static rules
Cube designers may be not familiar with business related query patterns, resulting in few static rules able to applied
Static rules created at first may not correct or user query patterns are changing dynamically

The goal of cube planner is to reduce effort for cube admins to design an effective partial cube. It owns the following advantages:

No sophisticated combination of static rules is needed
Allow more dimensions to be included with few static rules
Able to adjust a non-cost-effective cuboid set to a cost-effective one based on historical queries

relates to

KYLIN-3138 cuboids on-demand build

1.	Introduce a new cuboid scheduler based on cuboid tree rather than static rules	Closed	Gang Ma
2.	Add basic support classes for cube planner algorithms	Closed	Zhong Yanghong
3.	Introduce greedy algorithm for cube planner	Closed	Wang Ken
4.	Introduce genetic algorithm for cube planner	Closed	Wang Ken
5.	Enable cube planner phase one	Closed	Wang Ken
6.	Introduce base cuboid as a new input for cubing job	Closed	Wang Ken
7.	Introduce checkpoint executable	Closed	Zhong Yanghong
8.	Change maxLevel for layered cubing	Closed	Zhong Yanghong
9.	Introduce optimize job for adjusting cuboid set	Closed	Zhong Yanghong
10.	Introduce sunburst chart to show cuboid tree	Closed	Julian Pan
11.	Introduce hot cuboids export & import	Closed	Zhong Yanghong
12.	Introduce an option to make job scheduler consider job priority	Closed	Zhong Yanghong
13.	Create a document for cube planner	Closed	qianqiaoneng
14.	Fix the blocking issue in Cube optimizing job	Closed	Zhong Yanghong