Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-8916

Unreliable kafka-reassign-partitions.sh affecting performance

    XMLWordPrintableJSON

    Details

    • Type: Task
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.1
    • Fix Version/s: None
    • Component/s: admin, config
    • Labels:
    • Environment:
      CentOS 7
    • Flags:
      Important

      Description

      Currently I have 3 node kafka cluster, and I want to add 2 more nodes to make it 5 node cluster.
      *After adding the nodes to cluster, I need all the topic partitions to be evenly distributed across all the 5 nodes.
      **In the past, when I ran kafka-reassign-partitions.sh & kafka-preferred-replica-election.sh, it ran for very long time, hung & made the cluster unstable. So I'm afraid to use this method.

      Can you please suggest the best & foolproof way to assign partitions among all the cluster nodes.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Vinayzxzx VinayKumar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: