[SPARK-33058] Fetch topic partitions once when getting offset ranges

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 3.1.0
• Component/s: SQL
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 03/Oct/20 06:34
• Updated: 03/Oct/20 17:09
• Resolved: 03/Oct/20 17:09

Description

We fetch topic partition twice by `fetchPartitionOffsets` in `KafkaOffsetReader` when trying to fetch partition offsets. We can reduce unnecessary poll.

Issue Links

• duplicates: SPARK-32032 Eliminate deprecated poll(long) API calls to avoid infinite wait in driver
• links to: [Github] Pull Request #29937 (viirya)
• links to: [Github] Pull Request #29937 (viirya)