XMLWordPrintableJSON

    Details

      Description

      Clone tasks immediately, without waiting for anything. (e.g., waiting until some other tasks finish to identify stragglers) 

      Tests

      • TaskRetryTest: Cloned tasks should be handled correctly under failures
      • WordCountITCase#testClones: Cloned Map and Reduce tasks

      Optimizer

      • CloneProperty extends VertexExecutionProperty<Integer>
      • ClonePass: Sets CloneProperty to 2

      Runtime

      • A state machine per task attempt
      • Data Plane: Use any one of the parent task attempts' output blocks
      • Control Plane: Looks up the CloneProperty to schedule N attempts at a time 

        Attachments

          Activity

            People

            • Assignee:
              johnyangk John Yang
              Reporter:
              johnyangk John Yang
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: