[FLINK-21688] we use setIncreaseParallelism function, can cause slow flush in restore

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Information Provided
• Affects Version/s: 1.11.3
• Component/s: Runtime / State Backends
• Assignee: Unassigned
• Reporter: xiaogang zhou
• Created: 09/Mar/21 08:44
• Updated: 30/Mar/21 12:53
• Resolved: 30/Mar/21 06:36

Description

we use setIncreaseParallelism function, can cause slow flush in restore rescaling case. As this function limits the HIGH threads to 1.

 

Why not set the MAX jobs to 40, which will offer more flush thread to enable a fast recovery