[BEAM-8402] Create a class hierarchy to represent environments

• Type: New Feature
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.18.0
• Component/s: sdk-py-core
• Labels: backward-incompatible
• Assignee: Chad Dombrova
• Reporter: Chad Dombrova
• Created: 15/Oct/19 05:09
• Updated: 13/Apr/23 11:00
• Resolved: 16/Feb/20 21:16

Description

As a first step towards making it possible to assign different environments to sections of a pipeline, we first need to expose environment classes to the pipeline API. Unlike PTransforms, PCollections, Coders, and Windowings, environments exists solely in the portability framework as protobuf objects. By creating a hierarchy of "native" classes that represent the various environment types – external, docker, process, etc – users will be able to instantiate these and assign them to parts of the pipeline. The assignment portion will be covered in a follow-up issue/PR.

Issue Links

• links to: GitHub Pull Request #9811