[KAFKA-10532] Do not wipe state store under EOS when closing-dirty a RESTORING active or RUNNING standby task

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Component/s: streams
• Labels: new-streams-runtime-should-fix newbie++
• Assignee: Eduwer Camacaro
• Reporter: Guozhang Wang
• Created: 28/Sep/20 22:57
• Updated: 15/Nov/24 14:56

Description

Today whenever we are closing-dirty a task, we always wipe out the state stores if we are under EOS. But when the closing task was a RESTORING active, or a RUNNING standby, we may actually not need to wipe out the stores since we know that upon resuming, we would still continue restoring the task before transit to processing ever (assuming the LEO offset would not be truncated), i.e. when they resumes it does not matter if the same records gets applied twice during the continued restoration.

Issue Links

• relates to: KAFKA-13350 Handle task corrupted exception on a per state store basis
• links to: GitHub Pull Request #13097
• links to: GitHub Pull Request #17761