[FLINK-17096] Mini-batch group aggregation doesn't expire state even if state ttl is enabled

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 1.9.0, 1.10.0, 1.11.0
• Fix Version/s: 1.12.0
• Component/s: Table SQL / Runtime
• Labels: pull-request-available
• Assignee: dalongliu
• Reporter: dalongliu
• Created: 13/Apr/20 02:40
• Updated: 27/Dec/20 06:19
• Resolved: 20/Nov/20 07:30

Description

At the moment, MiniBatch Group Agg include Local/Global doesn`t support State TTL, for streaming job, it will lead to OOM in long time running, so we need to make state data expire after ttl, the solution is that use incremental cleanup feature refer to FLINK-16581

Issue Links

• duplicates: FLINK-18872 Aggregate with mini-batch does not respect state retention
• duplicates: FLINK-17099 Refactoring State TTL solution in Group Agg、Deduplication、TopN operators replace Timer with StateTtlConfig
• links to: GitHub Pull Request #11830