Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15634

disableAutoGeneratedUIDs fails with coGroup and join

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.10.0
    • Fix Version/s: None
    • Component/s: API / DataStream
    • Labels:
      None

      Description

      coGroup/join seems to generate two Map operators for which you can't set the UID. 

      Here's a test case:

      @Test
      public void testDisablingAutoUidsWorksWithCoGroup() throws Exception {
         StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment();
         env.getConfig().disableAutoGeneratedUIDs();
      
         env
            .addSource(new NoOpSourceFunction()).setUidHash("aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa")
            .coGroup(env.addSource(new NoOpSourceFunction()).setUidHash("bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"))
            .where(o -> o).equalTo(o -> o)
            .window(TumblingEventTimeWindows.of(Time.days(1)))
            .with(new CoGroupFunction<String, String, Object>() {
               @Override
               public void coGroup(Iterable<String> first, Iterable<String> second, Collector<Object> out) throws Exception {
               }
            }).setUidHash("cccccccccccccccccccccccccccccccc")
            .addSink(new DiscardingSink<>()).setUidHash("dddddddddddddddddddddddddddddddd");
      
         env.execute();
      }
      

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jkreileder Jürgen Kreileder
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: