[FLINK-13632] Port serializer upgrade tests to TypeSerializerUpgradeTestBase

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.11.0
• Component/s: API / Type Serialization System, Tests
• Labels: pull-request-available
• Assignee: Aljoscha Krettek
• Reporter: Till Rohrmann
• Created: 07/Aug/19 10:02
• Updated: 27/Apr/21 18:08
• Resolved: 28/May/20 12:07

Description

FLINK-11767 introduced a new test base (TypeSerializerUpgradeTestBase) for writing serializer upgrade tests. Now we need to migrate all existing tests from TypeSerializerSnapshotMigrationTestBase to use the new test base and update them to restore from Flink 1.8 onward.

It seems these are the subclasses:

• TtlSerializerStateMigrationTest (org.apache.flink.runtime.state.ttl)
• ValueSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• PrimitiveArraySerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils.base.array)
• AvroSerializerMigrationTest (org.apache.flink.formats.avro.typeutils)
• TupleSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• BufferEntrySerializerMigrationTest (org.apache.flink.streaming.api.operators.co)
• TimerSerializerSnapshotMigrationTest (org.apache.flink.streaming.api.operators)
• StreamElementSerializerMigrationTest (org.apache.flink.streaming.runtime.streamrecord)
• KryoSnapshotMigrationTest (org.apache.flink.api.java.typeutils.runtime.kryo)
• BaseTypeSerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils.base)
• NullableSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• VoidNamespacieSerializerSnapshotMigrationTest (org.apache.flink.runtime.state)
• ScalaOptionSerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)
• ScalaTrySerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)
• JavaSerializerSnapshotMigrationTest (org.apache.flink.runtime.state)
• LockableTypeSerializerSnapshotMigrationTest (org.apache.flink.cep.nfa.sharedbuffer)
• NFASerializerSnapshotsMigrationTest (org.apache.flink.cep)
• WindowSerializerSnapshotsMigrationTest (org.apache.flink.streaming.runtime.operators.windowing)
• UnionSerializerMigrationTest (org.apache.flink.streaming.api.datastream)
• TwoPhaseCommitSinkStateSerializerMigrationTest (org.apache.flink.streaming.api.functions.sink)
• KafkaSerializerSnapshotsMigrationTest (org.apache.flink.streaming.connectors.kafka)
• KafkaSerializerSnapshotsMigrationTest (org.apache.flink.streaming.connectors.kafka)
• RowSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• ValueArraySerializerSnapshotMigrationTest (org.apache.flink.graph.types.valuearray)
• MapSerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils.base)
• CompositeTypeSerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils)
• ListSerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils.base)
• EnumSerializerSnapshotMigrationTest (org.apache.flink.api.common.typeutils.base)
• PojoSerializerSnapshotMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• ArrayListSerializerMigrationTest (org.apache.flink.runtime.state)
• CopyableSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• WritableSerializerMigrationTest (org.apache.flink.api.java.typeutils.runtime)
• ListViewSerializerSnapshotMigrationTest (org.apache.flink.table.dataview)
• MapViewSerializerSnapshotMigrationTest (org.apache.flink.table.dataview)
• ScalaEitherSerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)
• LongValueWithProperHashCodeSerializerSnapshotMigrationTest (org.apache.flink.graph.drivers.transform)
• ScalaCaseClassSerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)
• TraversableSerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)
• EnumValueSerializerSnapshotMigrationTest (org.apache.flink.api.scala.typeutils)

Issue Links

• is blocked by: FLINK-11767 Introduce new TypeSerializerUpgradeTestBase, new PojoSerializerUpgradeTest
• is blocked by: FLINK-15474 In TypeSerializerUpgradeTestBase, create serializer snapshots "on demand"
• is related to: FLINK-13613 Update state migration tests for Flink 1.9
• links to: GitHub Pull Request #10902
• links to: GitHub Pull Request #12361
• links to: GitHub Pull Request #12363