[KAFKA-7959] Clear/delete epoch cache if old message format is in use

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.2
• Assignee: Stanislav Kozlovski
• Reporter: Jason Gustafson
• Created: 20/Feb/19 17:03
• Updated: 22/Feb/19 23:49
• Resolved: 22/Feb/19 23:49

Description

Because of KAFKA-7897, it is possible to have a sparse epoch cache when using the old message format. The fix for that issue addresses the problem of improper use of that cache while the message format remains on an older version. However, it leaves the possibility of misuse during a message format upgrade, which can cause unexpected truncation and re-replication. To fix the problem, we should delete or at least clear the cache whenever the old message format is used.

Note that this problem was fixed unintentionally in 2.1 with the patch for KAFKA-7897. This issue applies specifically to the 2.0 branch.

Issue Links

• links to: GitHub Pull Request #6298