Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26985

Test "access only some column of the all of columns " fails on big endian

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.2
    • Fix Version/s: 2.4.5, 3.0.0
    • Component/s: SQL
    • Environment:

      Description

      While running tests on Apache Spark v2.3.2 with AdoptJDK on big endian, I am observing test failures for 2 Suites of Project SQL.
      1. InMemoryColumnarQuerySuite
      2. DataFrameTungstenSuite
      In both the cases test "access only some column of the all of columns" fails due to mismatch in the final assert.

      Observed that the data obtained after df.cache() is causing the error. Please find attached the log with the details. 

      cache() works perfectly fine if double and  float values are not in picture.

      Inside test !!!!!!- access only some column of the all of columns *** FAILED ***

        Attachments

        1. access only some column of the all of columns.txt
          4 kB
          Anuja Jakhade
        2. InMemoryColumnarQuerySuite.txt
          2 kB
          Anuja Jakhade
        3. DataFrameTungstenSuite.txt
          2 kB
          Anuja Jakhade

          Issue Links

            Activity

              People

              • Assignee:
                ketan22584 ketan kunde
                Reporter:
                Anuja Anuja Jakhade
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: