Details

    Description

      • Implement PartitionShuffleDescriptor for covering necessary abstract info.
      • Implement ShuffleDeploymentDecriptor generated from PartitionShuffleDecriptor.
      • Define ShuffleMaster interface and create a simple implementation on JM side which¬†relies on¬†currently implemented NetworkEnviroment on TM side.
      • Define ShuffleManager interface for creating ShuffleMaster.
      • Introduce a Flink configuration option for ShuffleManager implementation. Default value for it could be <none> which serves as a feature flag at the moment to use current code paths.

      Attachments

        Activity

          People

            azagrebin Andrey Zagrebin
            azagrebin Andrey Zagrebin
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m