Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2085

Transforms could give hints to runners on resource requirements

Attach filesAttach ScreenshotAdd voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

      Description

      As discussed in BEAM-673 runners can allocate workers to accomplish their work in a better way if they can take into account some hints from the transforms, e.g. a source can hint data locality and with this information the runner can allocate the workers in an better way, this can also be the case with a particular transform that can suggest to the runner to be executed in a worker with a specific resource, e.g. GPU.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              iemejia Ismaël Mejía

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 39h 40m
                39h 40m

                  Issue deployment