[FLINK-33515] PythonDriver need to stream python process output to log instead of collecting it in memory

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.19.0
• Fix Version/s: 1.19.0
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Gabor Somogyi
• Reporter: Gabor Somogyi
• Created: 10/Nov/23 08:33
• Updated: 13/Nov/23 10:59
• Resolved: 13/Nov/23 10:59

Description

PythonDriver now collects the python process output in a Stringbuilder instead of streaming it. It can cause OOM when the python process is generating huge amount of output.

Issue Links

• links to: GitHub Pull Request #23697