[BEAM-10078] uniquify Dataflow specific jars when staging

• Type: Improvement
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.22.0
• Component/s: cross-language, runner-dataflow
• Assignee: Heejong Lee
• Reporter: Heejong Lee
• Created: 26/May/20 02:31
• Updated: 29/May/20 19:13
• Resolved: 29/May/20 19:13

Description

After BEAM-9383, Dataflow specific jars (dataflow-worker.jar, windmill_main) could be overwritten when two or more jobs share the same staging location. Since they 1) should have specific predefined names AND 2) should have unique location for avoiding collision, they need special handling when staging artifacts.

Issue Links

• links to: GitHub Pull Request #11814
• links to: GitHub Pull Request #11814
• links to: GitHub Pull Request #11859