[FLINK-32898] Improvement of usability for Flink OLAP

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Client / Job Submission, Runtime / Configuration, Runtime / Coordination, Table SQL / JDBC, Table SQL / Runtime
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: xiangyu feng
• Created: 21/Aug/23 04:26
• Updated: 06/Dec/23 07:43

Description

By building Flink OLAP services internally using Flink master branch, we realized that if we want to involve more community users to use Flink OLAP, besides scheduling and execution performance improvement mentioned in FLINK-25318, we also need to improve some basic usability issues in OLAP scenarios, including providing quick start for users to build Flink OLAP service, allocating minimum resources when cluster start, displaying detailed job sql in flink ui, etc.

 

Meanwhile, we believe this can also optimize the user experience of running batch jobs in session cluster mode. So after talk with zjureel , we create this jira to track the progress of related work.

Issue Links

• is a parent of: FLINK-25015 job name should not always be `collect` submitted by sql client
• is a parent of: FLINK-15959 Add min number of slots configuration to limit total number of slots
• is a parent of: FLINK-32863 Improve Flink UI's time precision from second level to millisecond level
• is related to: FLINK-25318 Improvement of scheduler and execution for Flink OLAP
• is related to: FLINK-32488 Introduce configuration to control ExecutionGraph cache in REST API
• links to: GitHub Pull Request #23842

Sub-Tasks

• Support setting env.java.opts.sql-gateway to specify the jvm opts for sql gateway: Closed
• Add quick start guide for Flink OLAP: Closed
• FLIP-374: Adding a separate configuration for specifying Java Options of the SQL Gateway: Closed
• Translate Flink OLAP quick start guide to Chinese: Closed
• Improve the Quickstart guide for Flink OLAP and translate to Chinese: Resolved
• SQL Gateway supports IPv6 addresses.: Closed
• Support concurrent serialization in akka: Open