Details

      Description

      • Implement PartitionShuffleDescriptor for covering necessary abstract info.
      • Implement ShuffleDeploymentDecriptor generated from PartitionShuffleDecriptor.
      • Define ShuffleMaster interface and create a simple implementation on JM side which¬†relies on¬†currently implemented NetworkEnviroment on TM side.
      • Define ShuffleManager interface for creating ShuffleMaster.
      • Introduce a Flink configuration option for ShuffleManager implementation. Default value for it could be <none> which serves as a feature flag at the moment to use current code paths.

        Attachments

          Activity

            People

            • Assignee:
              azagrebin Andrey Zagrebin
              Reporter:
              azagrebin Andrey Zagrebin
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m