[FLINK-25592] Improvement of parser, optimizer and execution for Flink Batch SQL

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Table SQL / API, Table SQL / Planner, Table SQL / Runtime
• Assignee: Unassigned
• Reporter: Jing Zhang
• Created: 10/Jan/22 13:36
• Updated: 09/Aug/22 04:42

Description

This is a parent JIRA to track improvements on Flink Batch SQL, including parser, optimizer and execution.
For example,
1. using Hive dialect and default dialect, some sql query would be translated into different plans
2. specify hash/sort aggregate strategy and hash/sort merge join strategy in sql hint
3. take parquet metadata into consideration in optimization
4. and so on
Please note, some improvements are not limited to batch sql. Maybe streaming sql job could also benefits from some improvements in this JIRA.

Sub-Tasks

• Take parquet metadata into consideration when source is parquet files: Open
• Specify hash/sortmerge join in SQL hint: Open
• Remove useless aggregate function: Open
• Support Hive bucket table: In Progress
• Flink batch support for Hive StorageHandlers: Open
• Hive dialect fails using union map type: Open