[BEAM-4231] Runner utility for Coder instantiation

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: runner-core
• Assignee: Ben Sidhom
• Reporter: Ben Sidhom
• Created: 03/May/18 21:19
• Updated: 24/Jul/20 20:17
• Resolved: 21/Jun/18 21:10

Description

Portable runners need to instantiate coders for communicating with SDK harnesses in a consistent way. They cannot simply instantiate coders as defined by PCollections because some component coders may only be known to specific SDKs. Unknown coders should be length-prefixed; the underlying elements should only be exposed to runners as byte strings.

Issue Links

• is depended upon by: BEAM-4285 Flink batch state request handler
• is depended upon by: BEAM-2889 Flink runs portable pipelines
• links to: GitHub Pull Request #5274