[FLINK-33317] Add cleaning mechanism for StreamConfig#SERIALIZEDUDF

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.17.0, 1.18.0
• Fix Version/s: 1.19.0
• Component/s: Runtime / Configuration
• Labels: pull-request-available
• Assignee: Rui Fan
• Reporter: Rui Fan
• Created: 19/Oct/23 08:53
• Updated: 07/Nov/23 09:41
• Resolved: 07/Nov/23 09:41

Description

See FLINK-33315 for details.

This Jira focus on avoid unnecessary memory usage, it can optimize the memory cost of Replica_3 in FLINK-33315.

 

Solution:

• After getStreamOperatorFactory,  the StreamConfig#SERIALIZEDUDF can be cleaned

In general, we don't clean any configuration. However, the SERIALIZED_UDF may be very large when operator includes some large objects.

{@link #getStreamOperatorFactory}

is used to create a StreamOperator and usually only needs to be called once.

Callers can clean it to reduce the memory after calling the {@link #getStreamOperatorFactory}.

Issue Links

• links to: GitHub Pull Request #23589