[FLINK-11436] Java deserialization failure of the AvroSerializer when used in an old CompositeSerializers

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.7.0, 1.7.1
• Fix Version/s: 1.7.2
• Component/s: API / Type Serialization System
• Labels: pull-request-available
• Assignee: Igal Shilman
• Reporter: Igal Shilman
• Created: 27/Jan/19 07:34
• Updated: 29/Jan/19 07:18
• Resolved: 29/Jan/19 07:18

Description

During the release of Flink 1.7, the value of AvroSerializer, serialVersionUID was uptick to 2L (was 1L before).

Although the AvroSerializer (along with it's snapshot class) was migrated to the new serialization abstraction (hence free of Java serialization), there were composite serializers that were not yet migrated during that release (i.e. StreamElementSerializer), and were serialized with Java serialization into the checkpoint/savepoint.

In case that one of the nested serializers were the AvroSerializer we would
bump into deserialization exception due to a wrong serialVersionUID.

This issue was initially reported on the user mailing list:

http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Trouble-migrating-state-from-1-6-3-to-1-7-1-td25694.html

 

Issue Links

• links to: GitHub Pull Request #7580