[FLINK-3762] Kryo StackOverflowError due to disabled Kryo Reference tracking

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.1
• Fix Version/s: 1.0.2, 1.1.0
• Assignee: Andrew Palumbo
• Reporter: Andrew Palumbo
• Created: 14/Apr/16 18:00
• Updated: 28/Feb/19 13:20
• Resolved: 15/Apr/16 18:58

Description

As discussed on the dev list,

In KryoSerializer.java

Kryo Reference tracking is disabled by default:

    kryo.setReferences(false);

This can causes StackOverflowError Exceptions when serializing many objects that may contain recursive objects:

java.lang.StackOverflowError
	at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:48)
	at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
	at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
	at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
	at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
	at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
	at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
	at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)
	at com.esotericsoftware.kryo.Kryo.writeObject(Kryo.java:523)
	at com.esotericsoftware.kryo.serializers.ObjectField.write(ObjectField.java:61)
	at com.esotericsoftware.kryo.serializers.FieldSerializer.write(FieldSerializer.java:495)

By enabling reference tracking, we can fix this problem.

[1]https://gist.github.com/andrewpalumbo/40c7422a5187a24cd03d7d81feb2a419