[KAFKA-10688] Handle accidental truncation of repartition topics as exceptional failure

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: streams
• Labels: new-streams-runtime-should-fix
• Assignee: Unassigned
• Reporter: Guozhang Wang
• Created: 05/Nov/20 23:09
• Updated: 14/Mar/23 04:26

Description

Today we always handle InvalidOffsetException from the main consumer by the resetting policy assuming they are for source topics. But repartition topics are also source topics and should never be truncated and hence cause InvalidOffsetException.

We should differentiate these repartition topics from external source topics and treat the InvalidOffsetException from repartition topics as fatal and close the whole application.