[KAFKA-12541] Extend ListOffset to fetch offset with max timestamp (KIP-734)

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: admin
• Labels: needs-kip
• Assignee: Tom Scott
• Reporter: Tom Scott
• Reviewer: David Jacot
• Created: 24/Mar/21 11:57
• Updated: 24/Mar/22 08:27
• Resolved: 25/Jun/21 12:31

Description

In Kafka 2.7 the following method was added to AdminClient that provides this information:

public ListOffsetsResult listOffsets(Map<TopicPartition,OffsetSpec> topicPartitionOffsets,                                      ListOffsetsOptions options)

https://kafka.apache.org/27/javadoc/org/apache/kafka/clients/admin/KafkaAdminClient.html#listOffsets-java.util.Map-org.apache.kafka.clients.admin.ListOffsetsOptions-

where OffsetSpec can be:

• OffsetSpec.EarliestSpec
• OffsetSpec.LatestSpec
• OffsetSpec.TimestampSpec

 
This ticket introduces a new spec:

OffsetSpec.MaxTimestampSpec // this returns the offset and timestamp for the record with the highest timestamp.

This indicates to the AdminClient that we want to fetch the timestamp and offset for the record with the largest timestamp produced to a partition.

Issue Links

• is related to: KAFKA-13002 listOffsets must downgrade immediately for non MAX_TIMESTAMP specs
• links to: GitHub Pull Request #10760

Sub-Tasks

• Support max timestamp in GetOffsetShell: Resolved