[SPARK-30656] Support the "minPartitions" option in Kafka batch source and streaming source v1

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.0
• Component/s: Structured Streaming
• Assignee: Shixiong Zhu
• Reporter: Shixiong Zhu
• Created: 27/Jan/20 23:19
• Updated: 31/Jan/20 02:16
• Resolved: 31/Jan/20 02:16

Description

Right now, the "minPartitions" option only works in Kafka streaming source v2. It would be great that we can support it in batch and streaming source v1 (v1 is the fallback mode when a user hits a regression in v2) as well.

Issue Links

• links to: GitHub Pull Request #27388