[KYLIN-2932] Simplify the thread model for in-memory cubing

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: v2.6.0
• Component/s: Job Engine
• Assignee: Wang Ken
• Reporter: Wang Ken
• Created: 12/Oct/17 09:04
• Updated: 12/Jan/19 06:41
• Resolved: 14/Dec/18 13:50

Description

The current implementation uses split threads, task threads and main thread to do the cube building, there is complex join and error handling logic.

The new implement leverages the ForkJoinPool from JDK, the event split logic is handled in
main thread. Cuboid task and sub-tasks are handled in fork join pool, cube results are collected
async and can be write to output earlier.

Issue Links

• links to: GitHub Pull Request #387