[BEAM-5395] BeamPython data plane streams data

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.8.0
• Component/s: sdk-py-harness
• Assignee: Robert Bradshaw
• Reporter: Robert Bradshaw
• Created: 17/Sep/18 10:51
• Updated: 16/May/20 13:59
• Resolved: 18/Sep/18 14:39

Description

Currently the default implementation is to buffer all data for the bundle. 

Experiments were made splitting at arbitrary byte boundaries, but it appears that Java requires messages to be split on element boundaries. For now we should implement that in Python (even if this means not being able to split up large elements among multiple messages). 

Issue Links

• links to: GitHub Pull Request #6405