Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7529

Kafka Connect JDBC doesn't push new records to Kafka Topic unless the connector is restarted

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Invalid
    • None
    • None
    • connect
    • None

    Description

      Hi,

      We have a Kafka Connect JDBC Source Connector which keeps polling for new records in a Oracle table every minute and push the new records to Kafka Topic. New records are determined by an incrementing column.

      In general everything works well but once in a while we see that even though there were new records with incrementing column those records doesn't get pushed to the Topic. There is no clue of any error in the logs and the connector is in running state. Only after we restart the Connector the new records are pushed to the Topic. 

      Any idea in what situation can this happen?. 

      Rgds
      Kashyap.

      Attachments

        Activity

          People

            Unassigned Unassigned
            kivaturi Kashyap Ivaturi
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: