[FLINK-10896] Extend state schema evolution support for more types

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: API / Type Serialization System
• Labels: auto-deprioritized-major auto-deprioritized-minor
• Assignee: Unassigned
• Reporter: Tzu-Li (Gordon) Tai
• Created: 15/Nov/18 10:49
• Updated: 19/Apr/22 10:44

Description

Whether or not a state's schema can be evolved (e.g., removing / adding fields to a POJO-typed state, modifying an Avro-type state's schema, etc.) depends on whether or not the type's corresponding TypeSerializer and its TypeSerializerSnapshot properly supports it.

As of Flink 1.7, we currently only have support for evolving Avro types (with FLINK-10605).
This tracks the support for other composite types that would benefit from an evolvable schema, such as POJOs, tuples, Scala case classes etc.

Sub-Tasks

• Support POJO state schema evolution: Closed
• Support Row/CRow state schema evolution: Open
• First-class support for Protobuf types with evolvable schema: Open