[AVRO-2134] Cannot define optional field tags in Avro schema

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.8.1
• Component/s: java
• Assignee: Unassigned Assign to me
• Reporter: raghugogi
• Created: 19/Jan/18 04:40
• Updated: 19/Jan/18 16:01

Description

We are designing an Avro schema for kafka event payload and trying to use that for validating event message with Avro schema by posting to Kafka rest proxy.

The avro schema has some fields which are defined with union encoding having null values   

{\"name\": \"address\", \"type\": ,[\"null\",\"string\"], default:null}

Our clients want to send event message data to kafka broker for some complex data types optionally i.e. without JSON key/value even though it is specified in Avro schema or few of the primitive data types as optional within complex data type.

Is there an avro version which can skip the validation for no field data sent in event message or payload for field specified in Avro schema?

 The error message we see as follows:

"error_code": 42203,

"message": "Conversion of JSON to Avro failed: Failed to convert JSON to Avro: Expected start-union. Got END_OBJECT"