Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-25214

Kafka v2 source may return duplicated records when `failOnDataLoss` is `false`

    XMLWordPrintableJSON

    Details

    • Target Version/s:

      Description

      When there are missing offsets, Kafka v2 source may return duplicated records when failOnDataLoss=false because it doesn't skip missing offsets.

        Attachments

          Activity

            People

            • Assignee:
              zsxwing Shixiong Zhu
              Reporter:
              zsxwing Shixiong Zhu
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: