[SPARK-33524] Change `InMemoryTable` not to use Tuple.hashCode for `BucketTransform`

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.1, 3.1.0
• Fix Version/s: 3.0.2, 3.1.0
• Component/s: SQL, Tests
• Assignee: Dongjoon Hyun
• Reporter: Dongjoon Hyun
• Created: 23/Nov/20 23:01
• Updated: 24/Nov/20 03:37
• Resolved: 24/Nov/20 03:37

Description

`sql/core` module seems to be broken. I will file a new Jira.

$ build/sbt "sql/testOnly *.DataSourceV2SQLSuite" -Pscala-2.13
...
[info] - SPARK-31255: Project a metadata column *** FAILED *** (96 milliseconds)
[info] - SPARK-31255: Projects data column when metadata column has the same name *** FAILED *** (77 milliseconds)

Issue Links

• is caused by: SPARK-32168 DSv2 SQL overwrite incorrectly uses static plan with hidden partitions
• is caused by: SPARK-31255 DataSourceV2: Add metadata columns
• is related to: SPARK-32808 Pass all `sql/core` module UTs in Scala 2.13
• links to: [Github] Pull Request #30477 (dongjoon-hyun)