Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11436

Java deserialization failure of the AvroSerializer when used in an old CompositeSerializers

    XMLWordPrintableJSON

    Details

      Description

      During the release of Flink 1.7, the value of AvroSerializer, serialVersionUID was uptick to 2L (was 1L before).

      Although the AvroSerializer (along with it's snapshot class) was migrated to the new serialization abstraction (hence free of Java serialization), there were composite serializers that were not yet migrated during that release (i.e. StreamElementSerializer), and were serialized with Java serialization into the checkpoint/savepoint.

      In case that one of the nested serializers were the AvroSerializer we would
      bump into deserialization exception due to a wrong serialVersionUID.

      This issue was initially reported on the user mailing list:

      http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Trouble-migrating-state-from-1-6-3-to-1-7-1-td25694.html

       

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                igal Igal Shilman
                Reporter:
                igal Igal Shilman
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m