[FLINK-22781] Incorrect result for group window aggregate when mini-batch is enabled

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: Table SQL / Planner
• Labels: pull-request-available
• Assignee: Jing Zhang
• Reporter: godfrey he
• Created: 26/May/21 09:15
• Updated: 22/Apr/22 06:59
• Resolved: 06/Jul/21 08:54

Description

We can reproduce this issue through adding the following code to GroupWindowITCase#testWindowAggregateOnUpsertSource method:

    tEnv.getConfig.getConfiguration.setBoolean(
      ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_ENABLED, true)
    tEnv.getConfig.getConfiguration.set(
      ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_ALLOW_LATENCY, Duration.ofSeconds(1))
    tEnv.getConfig.getConfiguration.setLong(
      ExecutionConfigOptions.TABLE_EXEC_MINIBATCH_SIZE, 10L)

The reason is the group window without any data (the data may be retracted) should not send any record.

Issue Links

• is caused by: FLINK-20487 Support to consume retractions for window aggregate operator
• links to: GitHub Pull Request #16219
• links to: GitHub Pull Request #16570
• links to: GitHub Pull Request #16584
• links to: GitHub Pull Request #18716
• links to: GitHub Pull Request #18719