Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-9204

Improve visibility of records being skipped by the `DeserializationSchema` in the Kafka / Kinesis connectors

    XMLWordPrintableJSON

    Details

      Description

      Currently, users have to write some log for visibility if they are skipping some record (by returning null from the deserialization schema).

      We should have better support for this natively in the connectors, either by adding logs if null is returned by the user deserialization schema, or adding counter metrics to track how many records were skipped so far.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              tzulitai Tzu-Li (Gordon) Tai
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: