[FLINK-22865] Optimize state serialize/deserialize in PyFlink

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Done
• Affects Version/s: 1.14.0
• Fix Version/s: 1.14.0
• Component/s: API / Python
• Labels: auto-unassigned pull-request-available
• Assignee: Huang Xingbo
• Reporter: Huang Xingbo
• Created: 03/Jun/21 08:38
• Updated: 14/Dec/21 09:05
• Resolved: 14/Jul/21 04:02

Description

Currently we use Pickle to serialize/deserialize all types of state. If we can use dedicated serializers to serialize/deserialize these state of python basic object. It can provide 3X performance improvement in serialize/deserialize.

Issue Links

• links to: GitHub Pull Request #16069