[KAFKA-12841] NPE from the provided metadata in client callback in case of ApiException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.6.0
• Fix Version/s: 3.2.0
• Component/s: clients
• Environment: Prod
• Flags: Patch, Important
• Assignee: Philip Nee
• Reporter: Avi Youkhananov
• Reviewer: Luke Chen
• Created: 24/May/21 11:08
• Updated: 27/Apr/22 08:19
• Resolved: 26/Apr/22 18:07

Description

1.
org.apache.kafka.clients.producer.Callback interface has method onCompletion(...)
Which says as part of the documentation :

The metadata for the record that was sent (i.e. the partition and offset). *An empty metadata with -1 value for all fields except for topicPartition will be returned if an error occurred.

We got an NPE from doSend(...) method in org.apache.kafka.clients.producer.KafkaProducer 
Which can occur in case ApiException was thrown ...
In case of ApiException it uses the regular callback instead of InterceptorCallback which also may cover the NPE.

2. More over RecordMetadata has method partition() which return int but can also throw NPE because TopicPartition might be null.

Stack trace attached.

 

Issue Links

• is duplicated by: KAFKA-13448 Kafka Producer Client Callback behaviour does not align with Javadoc
• links to: GitHub Pull Request #10951
• links to: GitHub Pull Request #11689
• links to: GitHub Pull Request #12064
• links to: GitHub Pull Request #12088