[KAFKA-7891] Reduce time to start kafka server with clean state

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.1.0
• Assignee: Unassigned
• Reporter: Pradeep Bansal
• Created: 01/Feb/19 05:56
• Updated: 01/Feb/19 05:56

Description

I am using kafka 2.1.0 and has 6 broker cluster. In this I had a scenario where a topic (with replication factor 3 and min insync replica as 2) leader went down and we lost its data. When starting this broker with fresh state, it took aroun 45 minutes to catch up with replicas (data size of 190 G).

 

Is it expected to take such a large period to recover. are there configuration using which this can be optimized.