[KAFKA-1689] automatic migration of log dirs to new locations

• Type: New Feature
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.8.1.1
• Fix Version/s: 1.1.0
• Component/s: config, core
• Labels: newbie++
• Assignee: Unassigned
• Reporter: Javier Alba
• Created: 08/Oct/14 08:42
• Updated: 20/Feb/18 23:48
• Resolved: 20/Feb/18 23:48

Description

There is no automated way in Kafka 0.8.1.1 to make a migration of log data if we want to reconfigure our cluster nodes to use several data directories where we have mounted new disks instead our original data directory.

For example, say we have our brokers configured with:

log.dirs = /tmp/kafka-logs

And we added 3 new disks and now we want our brokers to use them as log.dirs:

logs.dirs = /srv/data/1,/srv/data/2,/srv/data/3

It would be great to have an automated way of doing such a migration, of course without losing current data in the cluster.

It would be ideal to be able to do this migration without losing service.

Issue Links

• Is contained by: KAFKA-5163 Support replicas movement between log directories (KIP-113)