[FLINK-33494] FLIP-376: Add DISTRIBUTED BY clause

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.20.0
• Component/s: Table SQL / API

Release Note

Many SQL vendors expose the concepts of Partitioning, Bucketing, and Clustering. Here, we introduce the concept of Bucketing to Flink.

This change focuses solely on the syntax and necessary API changes to offer a native way of declaring bucketing. Similar to partitioning, runtime support is determined by a table's connector.

• Assignee: Jim Hughes
• Reporter: Timo Walther
• Created: 09/Nov/23 10:24
• Updated: 09/Jul/24 12:56
• Resolved: 28/Jun/24 13:33

Description

Many SQL vendors expose the concepts of Partitioning, Bucketing, and Clustering.

FLIP-376 proposes to introduce the concept of Bucketing to Flink.

It focuses solely on the syntax and necessary API changes to offer a native way of declaring bucketing. Whether this is supported or not during runtime should then be a connector characteristic - similar to partitioning.

Sub-Tasks

• Add DISTRIBUTED BY clause for CREATE TABLE: Closed
• Expose DISTRIBUTED BY clause via parser: Closed
• Add support for altering a distribution via ALTER TABLE: Closed
• Implement CatalogTable.Builder: Closed
• Implement TableDistribution toString: Closed
• Add documentation for distribution: Closed