[KAFKA-4403] Update KafkaBasedLog to use new endOffsets consumer API

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.10.1.0
• Fix Version/s: 0.10.2.0
• Component/s: connect
• Labels: newbie
• Assignee: Balint Molnar
• Reporter: Ewen Cheslack-Postava
• Reviewer: Ewen Cheslack-Postava
• Created: 13/Nov/16 21:51
• Updated: 30/Nov/16 03:22
• Resolved: 30/Nov/16 03:21

Description

As of 0.10.1.0 and KIP-79 (https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65868090) KafkaConsumer can now fetch offset information about topic partitions. Previously KafkaBasedLog had to use a seekToEnd + position approach to determine end offsets. With the new APIs we can simplify this code.

This isn't critical as the current code works fine, but would be a nice cleanup and simplification.

Issue Links

• links to: GitHub Pull Request #2176