Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6031

Expose standby replicas endpoints in StreamsMetadata

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: streams
    • Labels:

      Description

      Currently reads for a key are served by single replica, which has 2 drawbacks:

      • if replica is down there is a down time in serving reads for keys it was responsible for until a standby replica takes over
      • in case of semantic partitioning some replicas might become hot and there is no easy way to scale the read load

      If standby replicas would have endpoints that are exposed in StreamsMetadata it would enable serving reads from several replicas, which would mitigate the above drawbacks.
      Due to the lag between replicas reading from multiple replicas simultaneously would have weaker (eventual) consistency comparing to reads from single replica. This however should be acceptable tradeoff in many cases.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                schizhov Stanislav Chizhov
              • Votes:
                1 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: