[AVRO-2151] ReflectData, JsonEncoder encoding runtime exception

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.8.2
• Component/s: java
• Assignee: Unassigned
• Reporter: Xu ShiChang Desmond
• Created: 28/Feb/18 12:40
• Updated: 06/Jun/18 21:25

Description

Using reflect data has a problem if a field is an array of an object (eg String[]) and using JsonEncoder.

Simple  reproduction of the problem

public static class Record {
  private String[] myfield = new String[]{"hello world"};
}

public static void main(String[] args) throws IOException {
  Schema s = SchemaBuilder.record("Record")
    .fields()
      .name("myfield").type(
        Schema.createArray(
         Schema.create(Schema.Type.STRING)
        )
      ).noDefault()
    .endRecord();

  System.out.println(s);

  ReflectData d = new ReflectData();
  d.createDatumWriter(s).write(new Record(),   EncoderFactory.get().jsonEncoder(s, System.out, true));
}

org.apache.avro.AvroTypeException: Incorrect number of items written. 1 more required.
	at org.apache.avro.io.ParsingEncoder.pop(ParsingEncoder.java:60)
	at org.apache.avro.io.JsonEncoder.writeArrayEnd(JsonEncoder.java:259)
	at org.apache.avro.reflect.ReflectDatumWriter.writeArray(ReflectDatumWriter.java:112)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:120)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:159)
	at org.apache.avro.generic.GenericDatumWriter.writeField(GenericDatumWriter.java:166)
	at org.apache.avro.specific.SpecificDatumWriter.writeField(SpecificDatumWriter.java:90)
	at org.apache.avro.reflect.ReflectDatumWriter.writeField(ReflectDatumWriter.java:191)
	at org.apache.avro.generic.GenericDatumWriter.writeRecord(GenericDatumWriter.java:156)
	at org.apache.avro.generic.GenericDatumWriter.writeWithoutConversion(GenericDatumWriter.java:118)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:75)
	at org.apache.avro.reflect.ReflectDatumWriter.write(ReflectDatumWriter.java:159)
	at org.apache.avro.generic.GenericDatumWriter.write(GenericDatumWriter.java:62)
	at Bugged.main(Bugged.java:30)