Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11016

flink chain have a bug???

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Not A Bug
    • 1.6.2
    • None
    • None
    • None
    • windows localmode test&& standalone also have this problem 

    Description

      when I use flink consume kafka,like one key "asdaasd" is all stored in Kafka partition 0,and flink will consumer it if the kakfa consumer is always alive,and i didnot disableChiang,so kakfa task will combine 2 task or more,like flatmap,but i log the key "asdaasd",I found other task have this log,It like chain have a bug ??

       

      the log 

      Source: Custom Source -> Flat Map -> Sink: Print to Std. Out (1/3) LK5C7C3X9JA001286
      Source: Custom Source -> Flat Map -> Sink: Print to Std. Out (1/3) LK5C7C3X9JA001286
      Source: Custom Source -> Flat Map -> Sink: Print to Std. Out (2/3) LK5C7C3X9JA001286

       

      the debug code in flatMapFunction

       

      if (gb32960_uid.equals("LK5C7C3X9JA001286"))

      { log.info(Thread.currentThread().getName() + " " + gb32960_uid); }

      else

      { return; }

      Attachments

        Activity

          People

            Unassigned Unassigned
            spafka Wong
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: