[KAFKA-17457] Raise minimum MetadataVersion for ZK migration to 3.6

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 3.9.0, 3.7.2, 3.8.1
• Component/s: controller, migration
• Assignee: David Arthur
• Reporter: David Arthur
• Created: 31/Aug/24 19:26
• Updated: 10/Sep/24 20:09
• Resolved: 07/Sep/24 15:52

Description

In the 3.6.0 release notes, we announced that ZK migrations were production ready.

> The 3.6.0 release marked the first production ready release for the migration of Kafka clusters from a ZooKeeper metadata system to a KRaft metadata system. Users wanting to perform this migration are advised to first upgrade to 3.6.2 or 3.7.1 to receive important bug fixes.

Part of the reasoning behind this announcement was that the migration was feature complete at this point (migration transactions and migration of delegation tokens were included in 3.6). 

If users are on a software version of 3.6 or higher, we should not let them perform the migration at an older MetadataVersion. Otherwise, the migration will be done without the use of metadata transactions, which is not safe.

Issue Links

• is duplicated by: KAFKA-15381 Controller waiting for migration should only allow failover when transactions are supported
• links to: GitHub Pull Request #17094
• links to: GitHub Pull Request #17119
• links to: GitHub Pull Request #17120