[KAFKA-2477] Replicas spuriously deleting all segments in partition

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.8.2.1
• Fix Version/s: 0.9.0.0
• Assignee: Jiangjie Qin
• Reporter: Håkon Hitland
• Created: 26/Aug/15 12:59
• Updated: 14/Oct/15 20:05
• Resolved: 08/Oct/15 04:59

Description

We're seeing some strange behaviour in brokers: a replica will sometimes schedule all segments in a partition for deletion, and then immediately start replicating them back, triggering our check for under-replicating topics.

This happens on average a couple of times a week, for different brokers and topics.

We have per-topic retention.ms and retention.bytes configuration, the topics where we've seen this happen are hitting the size limit.

Issue Links

• contains: KAFKA-2621 nextOffsetMetadata should be changed after rolling a new log segment