[FLINK-30512] Flink SQL state TTL has no effect when using Interval Join

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.15.1, 1.16.1
• Component/s: Runtime / State Backends, Table SQL / Runtime
• Release Note: add param : set table.exec.source.idle-timeout=120s; the issue fixed.
• Assignee: Unassigned
• Reporter: wangkang
• Created: 27/Dec/22 11:58
• Updated: 06/Jan/23 03:43
• Resolved: 03/Jan/23 09:21

Description

Take the following join SQL program as an example:

SET 'table.exec.state.ttl' = '900000 ms';
select 
...
from kafka_source_dwdexpose as t1
left join kafka_source_expose_attr_click t3 
ON t1.mid = t3.mid and t1.sr = t3.sr 
and t1.time_local = t3.time_local 
and t1.log_ltz BETWEEN t3.log_ltz - INTERVAL '2' MINUTE  AND t3.log_ltz + INTERVAL '2' MINUTE 

the state size is getting bigger and bigger.

we also test the same sql with flink sql 1.13,the state size is stable.