[SPARK-48050] Log logical plan at query start

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0, 3.5.1
• Fix Version/s: 4.0.0
• Component/s: Structured Streaming
• Labels: pull-request-available
• Assignee: Fanyue Xia
• Reporter: Fanyue Xia
• Created: 30/Apr/24 01:51
• Updated: 30/Apr/24 12:49
• Resolved: 30/Apr/24 12:49

Description

We should log the logical plan of queries at query start. Have the logical plan in the logs will help us determine whether logical plans have changed between query runs.

Issue Links

• links to: GitHub Pull Request #46292