Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-26403

SinkWriter should emit all the pending committables on endOfInput

    XMLWordPrintableJSON

Details

    Description

      Currently the SinkWriterOperator not drained all the pending committables on endOfInput() and left them till final checkpoint, which would be in fact deserted. This might cause data loss or the CommitterOperator hanged on endOfInput() due to not received expected number of committables.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26314 StreamingCompactingFileSinkITCase.testFileSink failed on azure

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26321 KafkaSinkITCase.testWriteRecordsToKafkaWithExactlyOnceGuarantee fails on azure

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          supercedes

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26321 KafkaSinkITCase.testWriteRecordsToKafkaWithExactlyOnceGuarantee fails on azure

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #18938

          Activity

            People

              pltbkd Gen Luo
              gaoyunhaii Yun Gao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: