[SPARK-35431] Sort elements generated by collect_set in SQLQueryTestSuite

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.2, 3.2.0
• Fix Version/s: 3.1.2, 3.2.0
• Component/s: SQL, Tests
• Assignee: Takeshi Yamamuro
• Reporter: Takeshi Yamamuro
• Created: 18/May/21 05:10
• Updated: 18/May/21 06:22
• Resolved: 18/May/21 05:51

Description

To pass subquery/scalar-subquery/scalar-subquery-select.sql (SQLQueryTestSuite) in Scala v2.13, this ticket proposes to change the aggregate expr of a test query in the file from collect_set(...) to sort_array(collect_set(...)) because collect_set depends on the mutable.HashSet implementation and elements in the set are printed in a different order in Scala v2.12/v2.13.

Issue Links

• relates to: SPARK-35422 Many test cases failed in Scala 2.13 CI
• links to: [Github] Pull Request #32578 (maropu)