[KAFKA-13669] Log messages for source tasks with no offsets to commit are noisy and confusing

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.2.0
• Component/s: connect
• Assignee: Chris Egerton
• Reporter: Chris Egerton
• Created: 15/Feb/22 20:43
• Updated: 16/Mar/23 12:38
• Resolved: 17/Feb/22 01:51

Description

The messages that Connect emits during offset commit for source tasks that haven't accrued any new offsets since their last commit are logged at INFO level, which has confused some users who saw them and believed that something was wrong with their connector.

We introduced these fairly recently as part of the work in https://github.com/apache/kafka/pull/11323 for KAFKA-12226.

We may want to lower the level of these messages to DEBUG in order to avoid giving users the impression that something's wrong with their connector, especially if there's a source task running that has gotten fully caught-up with the system it's polling and is simply waiting for more data to become available.

Issue Links

• is caused by: KAFKA-14809 Connect incorrectly logs that no records were produced by source tasks
• links to: GitHub Pull Request #11770