[BEAM-2085] Transforms could give hints to runners on resource requirements

• Type: Improvement
• Status: Triage Needed
• Priority: P3
• Resolution: Unresolved
• Affects Version/s: Not applicable
• Component/s: beam-model, runner-core, sdk-java-core
• Labels: Clarified
• Assignee: Unassigned
• Reporter: Ismaël Mejía
• Created: 26/Apr/17 20:57
• Updated: 13/Apr/23 11:05

Description

As discussed in BEAM-673 runners can allocate workers to accomplish their work in a better way if they can take into account some hints from the transforms, e.g. a source can hint data locality and with this information the runner can allocate the workers in an better way, this can also be the case with a particular transform that can suggest to the runner to be executed in a worker with a specific resource, e.g. GPU.

Issue Links

• is related to: BEAM-673 Data locality for DoFns
• links to: GitHub Pull Request #14369
• links to: GitHub Pull Request #14370
• links to: GitHub Pull Request #14371
• links to: GitHub Pull Request #14390
• links to: GitHub Pull Request #14559
• links to: GitHub Pull Request #14602
• links to: GitHub Pull Request #14605
• links to: GitHub Pull Request #14607
• links to: GitHub Pull Request #14685

Sub-Tasks

• Support Resource Hints on CrossLanguage Transforms: Open