Details
Description
Class JsonConverter line: 582
private static JsonNode convertToJson(Schema schema, Object logicalValue) {
if (logicalValue == null) {
if (schema == null) // Any schema is valid and we don't have a default, so treat this as an optional schema
return null;
if (schema.defaultValue() != null)
return convertToJson(schema, schema.defaultValue());
if (schema.isOptional())
return JsonNodeFactory.instance.nullNode();
throw new DataException("Conversion error: null value for field that is required and has no default value");
}
....
}
Expect:
Value `null` is valid for an optional filed, even though the filed has a default value.
Only when field is required, the converter return default value fallback when value is `null`.
Actual:
Always return default value if `null` was given.
Example:
I'm not sure if the current behavior is the exactly expected, but at least on MySQL, a table define as
create table t1 { name varchar(40) not null, create_time datetime default '1999-01-01 11:11:11' null, update_time datetime default '1999-01-01 11:11:11' null }
Just insert a record:
INSERT INTO `t1` (`name`, `update_time`) VALUES ('kafka', null);
The result is:
{
"name": "kafka",
"create_time": "1999-01-01 11:11:11",
"update_time": null
}
But when I use debezium pull binlog and send the record to Kafka with JsonConverter, the result changed to:
{
"name": "kafka",
"create_time": "1999-01-01 11:11:11",
"update_time": "1999-01-01 11:11:11"
}
For more details, see: https://issues.jboss.org/browse/DBZ-1064
Attachments
Issue Links
- Blocked
-
KAFKA-15838 [Connect] ExtractField and InsertField NULL Values are replaced by default value even in NULLABLE fields
-
- In Progress
-
- links to
(2 links to)