[KAFKA-9192] NullPointerException if field in schema not present in value

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.1
• Fix Version/s: 2.2.3, 2.5.0, 2.3.2, 2.4.1
• Component/s: connect
• Assignee: Unassigned
• Reporter: Mark Tinsley
• Reviewer: Randall Hauch
• Created: 14/Nov/19 20:48
• Updated: 07/Nov/20 15:57
• Resolved: 12/Feb/20 22:20

Description

Given a message:

{
   "schema":{
      "type":"struct",
      "fields":[
         {
            "type":"string",
            "optional":true,
            "field":"abc"
         }
      ],
      "optional":false,
      "name":"foobar"
   },
   "payload":{
   }
}

I would expect, given the field is optional, for the JsonConverter to still process this value.

What happens is I get a null pointer exception, the stacktrace points to this line: https://github.com/apache/kafka/blob/2.1/connect/json/src/main/java/org/apache/kafka/connect/json/JsonConverter.java#L701 called by https://github.com/apache/kafka/blob/2.1/connect/json/src/main/java/org/apache/kafka/connect/json/JsonConverter.java#L181

Issue seems to be that we need to check and see if the jsonValue is null before checking if the jsonValue has a null value.

Issue Links

• is related to: KAFKA-8067 JsonConverter missing and optional field defaults result in a null pointer
• links to: GitHub Pull Request #7733