[SPARK-33273] Fix Flaky Test: ThriftServerQueryTestSuite. subquery_scalar_subquery_scalar_subquery_select_sql

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SQL, Tests
• Labels: correctness
• Assignee: Wenchen Fan
• Reporter: Dongjoon Hyun
• Created: 28/Oct/20 15:56
• Updated: 12/Dec/22 18:11
• Resolved: 15/Dec/20 09:31

Description

• https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/130369/testReport/org.apache.spark.sql.hive.thriftserver/ThriftServerQueryTestSuite/subquery_scalar_subquery_scalar_subquery_select_sql/

[info] - subquery/scalar-subquery/scalar-subquery-select.sql *** FAILED *** (3 seconds, 877 milliseconds)
[info]   Expected "[1]0	2017-05-04 01:01:0...", but got "[]0	2017-05-04 01:01:0..." Result did not match for query #3
[info]   SELECT (SELECT min(t3d) FROM t3) min_t3d,
[info]          (SELECT max(t2h) FROM t2) max_t2h
[info]   FROM   t1
[info]   WHERE  t1a = 'val1c' (ThriftServerQueryTestSuite.scala:197)

Issue Links

• is caused by: SPARK-33119 ScalarSubquery should returns the first two rows to avoid Driver OOM
• links to: [Github] Pull Request #30765 (cloud-fan)
• links to: [Github] Pull Request #30766 (sarutak)
• links to: [Github] Pull Request #30766 (sarutak)