Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26985

Test "access only some column of the all of columns " fails on big endian

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.2
    • Fix Version/s: 2.4.5, 3.0.0
    • Component/s: SQL
    • Environment:

      Description

      While running tests on Apache Spark v2.3.2 with AdoptJDK on big endian, I am observing test failures for 2 Suites of Project SQL.
      1. InMemoryColumnarQuerySuite
      2. DataFrameTungstenSuite
      In both the cases test "access only some column of the all of columns" fails due to mismatch in the final assert.

      Observed that the data obtained after df.cache() is causing the error. Please find attached the log with the details. 

      cache() works perfectly fine if double and  float values are not in picture.

      Inside test !!!!!!- access only some column of the all of columns *** FAILED ***

        Attachments

        1. access only some column of the all of columns.txt
          4 kB
          Anuja Jakhade
        2. DataFrameTungstenSuite.txt
          2 kB
          Anuja Jakhade
        3. InMemoryColumnarQuerySuite.txt
          2 kB
          Anuja Jakhade

          Activity

            People

            • Assignee:
              ketan22584 ketan kunde
              Reporter:
              Anuja Anuja Jakhade
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: