[FLINK-20539] Type mismatch when using ROW in computed column

• Type: Sub-task
• Status: Reopened
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.19.0, 1.18.2
• Component/s: Table SQL / API
• Labels: auto-unassigned pull-request-available
• Assignee: xuyang
• Reporter: Timo Walther
• Created: 08/Dec/20 14:41
• Updated: 01/Jul/24 10:59

Description

The following SQL:

env.executeSql(
	"CREATE TABLE Orders (\n"
	+ "    order_number BIGINT,\n"
	+ "    price        INT,\n"
	+ "    first_name   STRING,\n"
	+ "    last_name    STRING,\n"
	+ "    buyer_name AS ROW(first_name, last_name)\n"
	+ ") WITH (\n"
	+ "  'connector' = 'datagen'\n"
	+ ")");

env.executeSql("SELECT * FROM Orders").print();

Fails with:

Exception in thread "main" java.lang.AssertionError: Conversion to relational algebra failed to preserve datatypes:
validated type:
RecordType(BIGINT order_number, INTEGER price, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" first_name, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" last_name, RecordType:peek_no_expand(VARCHAR(2147483647) CHARACTER SET "UTF-16LE" EXPR$0, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" EXPR$1) NOT NULL buyer_name) NOT NULL
converted type:
RecordType(BIGINT order_number, INTEGER price, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" first_name, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" last_name, RecordType(VARCHAR(2147483647) CHARACTER SET "UTF-16LE" EXPR$0, VARCHAR(2147483647) CHARACTER SET "UTF-16LE" EXPR$1) NOT NULL buyer_name) NOT NULL
rel:
LogicalProject(order_number=[$0], price=[$1], first_name=[$2], last_name=[$3], buyer_name=[ROW($2, $3)])
  LogicalTableScan(table=[[default_catalog, default_database, Orders]])

	at org.apache.calcite.sql2rel.SqlToRelConverter.checkConvertedType(SqlToRelConverter.java:467)
	at org.apache.calcite.sql2rel.SqlToRelConverter.convertQuery(SqlToRelConverter.java:582)

Issue Links

• is related to: FLINK-31830 Coalesce on nested fields with different nullabilities will get wrong plan
• is related to: FLINK-33597 Can not use a nested column for a join condition
• links to: GitHub Pull Request #23519
• links to: GitHub Pull Request #23772