[SPARK-40466] Improve the error message if the DSv2 source is disabled but DSv1 streaming source is not available

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Component/s: Structured Streaming
• Assignee: Huanli Wang
• Reporter: Huanli Wang
• Created: 16/Sep/22 03:04
• Updated: 19/Sep/22 23:22
• Resolved: 19/Sep/22 23:22

Description

If the V2 data source is disabled, current behavior will fallback to use V1 data source. But it will throw error when the DSv1 is not available. Update the error message to indicate what config variable (spark.sql.streaming.disabledV2MicroBatchReaders) needs to be modified in order to enable the V2 data source.

Issue Links

• links to: [Github] Pull Request #37917 (huanliwang-db)
• links to: [Github] Pull Request #37917 (huanliwang-db)