Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28489

KafkaOffsetRangeCalculator.getRanges may drop offsets

    XMLWordPrintableJSON

    Details

      Description

      KafkaOffsetRangeCalculator.getRanges may drop offsets due to round off errors.

       

      This only affects queries using "minPartitions" option. A workaround is just removing the "minPartitions" option from the query.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zsxwing Shixiong Zhu
                Reporter:
                zsxwing Shixiong Zhu
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: