Kafka
  1. Kafka
  2. KAFKA-252

Generalize getOffsetsBefore API to a new more general API getLeaderMetadata

    Details

    • Type: Improvement Improvement
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.8.0
    • Fix Version/s: None
    • Component/s: core
    • Labels:

      Description

      The relevant discussion is here - https://issues.apache.org/jira/browse/KAFKA-238?focusedCommentId=13191350&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13191350 and on KAFKA-642

      We have an api that gets cluster-wide metadata (getTopicmetdata) which we use for bootstraping knowledge about the cluster. But some things can only be fetched from the leader for the partition.

      With replication, the metadata about log segments can only be returned by a broker that hosts that partition locally. It will be good to expose log segment metadata through a more general replica metadata API that in addition to returning offsets, also returns other metadata like - number of log segments, total size, last modified timestamp, highwater mark, and log end offset.

      It would be good to do a wiki design on this and get consensus on that first since this would be a public api.

        Issue Links

          Activity

          No work has yet been logged on this issue.

            People

            • Assignee:
              Unassigned
              Reporter:
              Neha Narkhede
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:

                Development