XMLWordPrintableJSON

    Details

      Description

      Here, we enable delayed task cloning (e.g., wait until stragglers are identified).

      Thanks to how the Nemo optimizer is designed, this policy can be specified on per-vertex basis.

      For example, for vertices processing small data we can clone aggressively early, and for vertices processing big data we can wait to selectively clone only stragglers.

      On the optimizer-side, we should add more knobs to the ClonedSchedulingProperty, and on the runtime-side we should make it understand and enforce the new knobs.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                johnyangk John Yang
                Reporter:
                johnyangk John Yang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: