[FLINK-13867] Write file only once when doing blocking broadcast shuffle

• Type: New Feature
• Status: Open
• Priority: Not a Priority
• Resolution: Unresolved
• Component/s: Runtime / Network
• Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
• Assignee: Unassigned
• Reporter: Kurt Young
• Created: 27/Aug/19 06:03
• Updated: 21/Dec/21 10:39

Description

When doing broadcast shuffle in BATCH/BLOCKING fashion, the producer can only write one copy of output data for all possible consumers, instead of writing one copy of data for each consumer.