Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25081

When chaining an operator of a side output stream, the num records sent displayed on the dashboard is incorrect

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Duplicate
    • 1.14.0
    • None
    • None

    Description

      As show in the following figure, "Map" is an operator of a side output stream, the num records sent of first vertex is 0.

       

      The job code is as follows:

      final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
      
      SingleOutputStreamOperator<Long> dataStream =
              env.addSource(new DataGeneratorSource<>(RandomGenerator.longGenerator(1, 1000)))
                      .returns(Long.class)
                      .setParallelism(10)
                      .slotSharingGroup("group1");
      
      DataStream<Long> sideOutput = dataStream.getSideOutput(new OutputTag<Long>("10") {});
      sideOutput.map(num -> num).setParallelism(10).slotSharingGroup("group1");
      
      dataStream.addSink(new DiscardingSink<>()).setParallelism(10).slotSharingGroup("group2");
      
      env.execute("WordCount"); 

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              wanglijie95 Lijie Wang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: