Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10686

Pluggable standby tasks assignor for Kafka Streams

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • streams

    Description

      In production, Kafka Streams instances often run across different clusters and availability zones. In order to guarantee high availability of the Kafka Streams deployments, users would need more granular control over which instances standby tasks can be created. 

      Idea of this ticket is to expose interface for Kafka Streams which can be implemented by the users to control where standby tasks can be created.

      Kafka Streams can have RackAware assignment as a default implementation that will take into account `rack.id` of the application and make sure that standby tasks are created on different racks. 

      Point of this ticket though is to give more flexibility to users on standby task creation, in cases where just rack awareness is not enough. 

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              lkokhreidze Levani Kokhreidze
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: