Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-918

Fix kafkaOffsetGen can not read kafka data bug

    XMLWordPrintableJSON

    Details

      Description

      When the sourcelimit is less than the number of Kafka partitions, Hudi cannot get the data

      Steps to reproduce:

      1、Use deltastreamer to consume data from kafka
      2、Set the value of sourceLimit to be less than the value of kafka partition
      3、INFO DeltaSync:313 - No new data, source checkpoint has not changed. Nothing to commit. Old checkpoint

        Attachments

          Activity

            People

            • Assignee:
              liujinhui liujinhui
              Reporter:
              liujinhui liujinhui
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: