[FLINK-25368] Use AdminClient to get offsets rather than KafkaConsumer

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.15.0
• Fix Version/s: 1.15.0
• Labels: pull-request-available
• Assignee: Deng Ziming
• Reporter: Deng Ziming
• Created: 18/Dec/21 02:19
• Updated: 11/Nov/24 02:33
• Resolved: 26/Jan/22 08:55

Description

`AdminClient.listOffsets` is provided in Kafka 2.7, In the future more `OffsetSpce` types will be added to it, for example, OffsetSpec.MaxTimestampSpec is added in Kafka 3.0. so it's better to substitute `KafkaConsumer` with `AdminClient`.

Issue Links

• relates to: FLINK-36674 Flink will not commit to kafka if checkpointing is not enabled
• links to: GitHub Pull Request #18145