[KAFKA-8613] Make Grace Period Mandatory for Windowed Operations in Streams

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.1.0, 3.0.0
• Component/s: streams
• Labels: kip
• Assignee: Israel Ekpo
• Reporter: Bruno Cadonna
• Created: 28/Jun/19 13:11
• Updated: 13/Oct/21 21:50
• Resolved: 01/Jul/21 22:01

Description

Currently, the grace period is set to retention time if the grace period is not specified explicitly. The reason for setting the default grace period to retention time was backward compatibility. Topologies that were implemented before the introduction of the grace period, added late arriving records to a window as long as the window existed, i.e., as long as its retention time was not elapsed.

This unintuitive default grace period has already caused confusion among users.

For the next major release, we should consider to set the default grace period to Duration.ZERO. or to make it a mandatory parameter.

 

KIP-633 

https://cwiki.apache.org/confluence/x/Ho2NCg

 

Issue Links

• blocks: KAFKA-12909 Allow users to opt-into spurious left/outer stream-stream join improvement
• relates to: KAFKA-8924 Default grace period (-1) of TimeWindows causes suppress to emit events after 24h
• links to: GitHub Pull Request #10924
• links to: GitHub Pull Request #10926