[KYLIN-4214] Distributed query engine

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Query Engine
• Assignee: yiming.xu
• Reporter: yiming.xu
• Created: 29/Oct/19 13:50
• Updated: 08/Nov/19 01:26

Description

Sql through calcite analysis optimization will generate a tree of OLAP rel,
and spark's catalyst is also generated by parsing SQL after a tree,
automatically optimized to become a dataframe to calculate, if the plan of
calcite can be converted into a spark plan, then we will achieve
distributed computing, calcite is only responsible for parsing SQL and
returning result sets, reducing the pressure on the kylin server side.

Issue Links

• Blocked: KYLIN-4188 Parquet as Cube storage V2

Sub-Tasks

• Add Spark Isolated class Loader: Open
• Add query engine interface: Open
• Calcite rel to Spark plan: Open