Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24085

Scalar subquery error

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 2.3.1
    • Fix Version/s: 2.3.1, 2.4.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Error

      SQL Error: java.lang.UnsupportedOperationException: Cannot evaluate expression: scalar-subquery

      Then query a partitioed table based on a parquet file then filter by partition column by scalar subquery.

      Query to reproduce:

      CREATE TABLE test_prc_bug (
      id_value string
      )
      partitioned by (id_type string)
      location '/tmp/test_prc_bug'
      stored as parquet;
      
      insert into test_prc_bug values ('1','a');
      insert into test_prc_bug values ('2','a');
      insert into test_prc_bug values ('3','b');
      insert into test_prc_bug values ('4','b');
      
      
      select * from test_prc_bug
      where id_type = (select 'b');
      

      If table in ORC format it works fine

        Attachments

          Activity

            People

            • Assignee:
              dkbiswal Dilip Biswal
              Reporter:
              abaturin Alexey Baturin
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: