Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14450 Rack-aware partition assignment for consumers (KIP-881)
  3. KAFKA-14352

Support rack-aware partition assignment for Kafka consumers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.4.0
    • consumer
    • None

    Description

      KIP-392 added support for consumers to fetch from the replica in their local rack. To benefit from locality, consumers need to be assigned partitions which have a replica in the same rack. This works well when replication factor is the same as the number of racks, since every rack would then have a replica with rack-aware replica assignment. If the number of racks is higher, some racks may not have replicas of some partitions and hence consumers in these racks will have to fetch from another rack. It will be useful to propagate rack in the subscription metadata for consumers and provide a rack-aware partition assignor for consumers.

      Attachments

        Issue Links

          Activity

            People

              rsivaram Rajini Sivaram
              rsivaram Rajini Sivaram
              David Jacot David Jacot
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: