[KAFKA-7262] Ability to support heterogeneous storage in Kafka

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.0.0
• Component/s: log
• Assignee: Unassigned
• Reporter: Fangbin Sun
• Created: 09/Aug/18 02:40
• Updated: 09/Aug/18 08:40

Description

Currently we have a batch of servers, each broker has one SSD (1.5T) and ten HDDs (10T). For all I know, Kafka itself doesn't know much about the underlying hardware, it chooses the directory with the least number of partitions when creating a topic-partition.

Is it possible to deploy a heterogeneous cluster for taking advantage of SSD with smaller disk capacity? Hope you all consider this. Any insights or guidance would be greatly appreciated.