Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6031

Expose standby replicas endpoints in StreamsMetadata

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: streams
    • Labels:

      Description

      Currently reads for a key are served by single replica, which has 2 drawbacks:

      • if replica is down there is a down time in serving reads for keys it was responsible for until a standby replica takes over
      • in case of semantic partitioning some replicas might become hot and there is no easy way to scale the read load

      If standby replicas would have endpoints that are exposed in StreamsMetadata it would enable serving reads from several replicas, which would mitigate the above drawbacks.
      Due to the lag between replicas reading from multiple replicas simultaneously would have weaker (eventual) consistency comparing to reads from single replica. This however should be acceptable tradeoff in many cases.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              schizhov Stanislav Chizhov

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment