[SPARK-36649] Support Trigger.AvailableNow on Kafka data source

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: Structured Streaming
• Labels: releasenotes
• Assignee: Boyang Jerry Peng
• Reporter: Jungtaek Lim
• Created: 02/Sep/21 06:08
• Updated: 16/Mar/22 07:25
• Resolved: 21/Jan/22 09:06

Description

SPARK-36533 introduces a new trigger Trigger.AvailableNow, but only introduces the new functionality to the file stream source. Given that Kafka data source is the one of major data sources being used in streaming query, we should make Kafka data source support this.

Issue Links

• links to: [Github] Pull Request #35238 (jerrypeng)
• links to: [Github] Pull Request #35238 (jerrypeng)