[SPARK-42687] Better error message for unspported `Pivot` operator in Structure Streaming

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.5.0
• Fix Version/s: 3.5.0
• Component/s: Structured Streaming
• Assignee: Huanli Wang
• Reporter: Huanli Wang
• Created: 06/Mar/23 18:40
• Updated: 06/Mar/23 23:13
• Resolved: 06/Mar/23 23:13

Description

pivot is an unsupported operation in structured streaming but produces a bad error message that is quite misleading.

 

The following is the current error message for the pivot in SS:
AnalysisException: Queries with streaming sources must be executed with writeStream.start();
 

Issue Links

• links to: [Github] Pull Request #40306 (huanliwang-db)