Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28489

KafkaOffsetRangeCalculator.getRanges may drop offsets

    XMLWordPrintableJSON

Details

    Description

      KafkaOffsetRangeCalculator.getRanges may drop offsets due to round off errors.

       

      This only affects queries using "minPartitions" option. A workaround is just removing the "minPartitions" option from the query.

      Attachments

        Issue Links

          Activity

            People

              zsxwing Shixiong Zhu
              zsxwing Shixiong Zhu
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: