[BEAM-8815] Portable pipeline execution without artifact staging

• Type: Task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.17.0
• Fix Version/s: 2.17.0
• Component/s: runner-core, runner-flink
• Labels: portability
• Assignee: Thomas Weise
• Reporter: Thomas Weise
• Created: 23/Nov/19 17:15
• Updated: 16/May/20 14:13
• Resolved: 04/Dec/19 04:43

Description

The default artifact staging implementation relies on a distributed filesystem. A directory and manifest will be created even when artifact staging isn't used, and the container boot code will fail retrieving artifacts, even though there are non. In a containerized environment it is common to package artifacts into containers. It should be possible to run the pipeline w/o a distributed filesystem. 

https://lists.apache.org/thread.html/1b0d545955a80688ea19f227ad943683747b17beb45368ad0908fd21@%3Cdev.beam.apache.org%3E

Issue Links

• links to: GitHub Pull Request #10205
• links to: GitHub Pull Request #10213
• links to: GitHub Pull Request #10285