[SPARK-26985] Test "access only some column of the all of columns " fails on big endian - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 2.3.2
Fix Version/s: 2.4.5, 3.0.0
Component/s: SQL
Labels:
- BigEndian
- correctness
Environment:

Hide

Linux Ubuntu 16.04

openjdk version "1.8.0_202"
OpenJDK Runtime Environment (build 1.8.0_202-b08)
Eclipse OpenJ9 VM (build openj9-0.12.1, JRE 1.8.0 64-Bit Compressed References 20190205_218 (JIT enabled, AOT enabled)
OpenJ9 - 90dd8cb40
OMR - d2f4534b
JCL - d002501a90 based on jdk8u202-b08)

Show
Linux Ubuntu 16.04 openjdk version "1.8.0_202" OpenJDK Runtime Environment (build 1.8.0_202-b08) Eclipse OpenJ9 VM (build openj9-0.12.1, JRE 1.8.0 64-Bit Compressed References 20190205_218 (JIT enabled, AOT enabled) OpenJ9 - 90dd8cb40 OMR - d2f4534b JCL - d002501a90 based on jdk8u202-b08)

Description

While running tests on Apache Spark v2.3.2 with AdoptJDK on big endian, I am observing test failures for 2 Suites of Project SQL.
1. InMemoryColumnarQuerySuite
2. DataFrameTungstenSuite
In both the cases test "access only some column of the all of columns" fails due to mismatch in the final assert.

Observed that the data obtained after df.cache() is causing the error. Please find attached the log with the details.

cache() works perfectly fine if double and float values are not in picture.

Inside test !!!!!!- access only some column of the all of columns *** FAILED ***