[SPARK-32458] Mismatched row access sizes in tests

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.1.0
• Component/s: SQL
• Labels: catalyst endianness
• Assignee: Michael Munday
• Reporter: Michael Munday
• Created: 27/Jul/20 10:18
• Updated: 28/Jul/20 17:37
• Resolved: 28/Jul/20 17:37

Description

The RowEncoderSuite and UnsafeMapSuite tests fail on big-endian systems. This is because the test data is written into the row using unsafe operations with one size and then read back using a different size. For example, in UnsafeMapSuite the test data is written using putLong and then read back using getInt. This happens to work on little-endian systems but these differences appear to be typos and cause the tests to fail on big-endian systems.

I have a patch that fixes the issue.

Issue Links

• links to: [Github] Pull Request #29258 (mundaym)