Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10745 Serialization and copy improvements for record writer
  3. FLINK-10790

Refactor all the StreamPartitioner implementations into runtime module

    XMLWordPrintableJSON

Details

    Description

      The motivation is for refactoring ChannelSelector interface mentioned inĀ FLINK-10662.

      The ChannelSelector implementations are separate for stream and batch currently, resulting in many duplicated logics for selecting channels. The root cause is that they are locating in different modules to not reuse the existing ones.

      In general, the core runtime codes should be unified for both stream and batch jobs as much as possible, then we can reduce the work overhead to maintain the duplicated codes.

      ThisĀ jira would migrate the existing partitioner package from flink-streaming-jave to flink-runtime. Next we want to de-duplicate implementations for RoundRobinChannelSelector and OutputEmitter.

      Attachments

        Issue Links

          Activity

            People

              zjwang Zhijiang
              zjwang Zhijiang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m