Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-15301

Flink Kinesis AsyncRecordEmitter needs to handle unchecked exception gracefully

    XMLWordPrintableJSON

Details

    Description

      Currently, any runTime exception encountered inside the `AsyncRecordEmitter.emitRecordAndUpdateState()` function could cause the thread to exit silently. Flink job would continue to run, but the stopped record emitter would subsequently cause Kinesis data consumption to stall. 

       

      The AsyncRecordEmitter need to catch unchecked exception, log errors, and perhaps trigger job restart subsequently. 

      Attachments

        Activity

          People

            thw Thomas Weise
            yxu-apache Ying Xu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 40m
                40m