[SPARK-48267] Regression e2e test with SPARK-47305

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0, 3.5.2
• Component/s: Structured Streaming
• Labels: pull-request-available
• Assignee: Jungtaek Lim
• Reporter: Jungtaek Lim
• Created: 14/May/24 03:33
• Updated: 14/May/24 06:48
• Resolved: 14/May/24 06:41

Description

In SPARK-47305, we fixed a bug in QO rule and added a test to demonstrate the issue and verify the fix works, but the scope of test was just to bugfix itself because we had no clear idea of (simpler) reproducer for e2e example.

We finally came up with simple reproducer which is e2e streaming query. We'd like to put this reproducer into test as regression test.

Issue Links

• links to: GitHub Pull Request #46569