[FLINK-20415] Parsed QueryOperation does not contain watermark in schema

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.11.2, 1.12.0
• Fix Version/s: 1.12.0
• Component/s: Table SQL / API
• Assignee: Unassigned
• Reporter: Ingo Bürk
• Created: 30/Nov/20 07:33
• Updated: 15/Mar/21 10:13
• Resolved: 15/Mar/21 10:13

Description

A parsed QueryOperation (e.g. from Parser#parse) does not contain the watermark information in its schema (QueryOperation#getTableSchema). The information does appear to be available in the calcite tree.

This can be reproduced by creating a simple table with a watermark, e.g.:

CREATE TABLE x (
  id INT,
  ts TIMESTAMP(3),
  WATERMARK FOR ts AS ts
) WITH (
  'connector' = 'datagen'
)

… and then parsing a statement like `SELECT * FROM x`.

API-wise, QueryOperation is currently marked internal (and as such this is only marked as an improvement), but TableSchema is public-evolving, and if QueryOperation was as well this could be seen as a bug instead.

 

Note that this might also affect other descendants of Operation which contain table schema information (I haven't tested all of them), e.g. CatalogQueryOperation.