[FLINK-24753] Enforce CHAR/VARCHAR precision when outputing to a Sink

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.15.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Release Note: CHAR/VARCHAR lengths are enforced (trimmed/padded) by default now before entering the table sink.
• Assignee: Marios Trivyzas
• Reporter: Marios Trivyzas
• Created: 03/Nov/21 14:03
• Updated: 17/Dec/21 13:53
• Resolved: 03/Dec/21 08:55

Description

When a column is declared with CHAR/VARCHAR with a specific precision, i.e. CHAR(10) a sink that would require following this precision strictly (like a relational DB) would throw errors if the records received exceed this limit.

 

Add an operator similar to the one SinkNotNullEnforcer and possible merge this functionality into one operator (i.e. SinkConstraintValidator)

Issue Links

• is a child of: FLINK-24413 Casting to a CHAR() and VARCHAR() doesn't trim the string to the specified precision
• links to: GitHub Pull Request #17811