[FLINK-7137] Flink table API defaults top level fields as nullable and all nested fields within CompositeType as non-nullable

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.1
• Fix Version/s: 1.3.2, 1.4.0
• Component/s: Table SQL / API
• Assignee: Rong Rong
• Reporter: Rong Rong
• Created: 07/Jul/17 23:50
• Updated: 19/Sep/19 19:16
• Resolved: 24/Jul/17 12:35

Description

Right now FlinkTypeFactory does conversion between Flink TypeInformation to Calcite RelDataType by assuming the following:

All top level fields will be set to nullable and all nested fields within CompositeRelDataType and GenericRelDataType will be set to Calcite default (which is non-nullable).

This triggers Calcite SQL optimization engine drop all `IS NOT NULL` clause on nested fields, and would not be able to optimize when top level fields were actually non-nullable.

Issue Links

• links to: GitHub Pull Request #4314