[KAFKA-1846] Offset storage topic should not default to replication factor 1

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.8.2.0
• Labels: newbie
• Assignee: Unassigned
• Reporter: Jay Kreps
• Created: 08/Jan/15 02:45
• Updated: 17/Jan/15 03:06
• Resolved: 17/Jan/15 03:06

Description

Currently the offset storage topic defaults to replication factor 1 (offsets.topic.replication.factor). Presumably this is because we want to make the single-node case work well "out of the box". But this is one of those obscure settings most people won't really know about so most people won't realize they are running this without replication. It would be better to change the default in KafkaConfig to -1 and have this set the replication factor dynamically when that topic is created to be the min(3,total_nodes), if on the other hand the user sets some value here we would use that.

In the absence of this I think many people will not realize what is happening until suddenly a broker dies and they can't commit offsets.

Issue Links

• is duplicated by: KAFKA-1864 Revisit defaults for the internal offsets topic
• relates to: KAFKA-1864 Revisit defaults for the internal offsets topic