Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13831

TPC-DS Query 35 fails with the following compile error

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete CommentsDelete
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0
    • SQL
    • None

    Description

      TPC-DS Query 35 fails with the following compile error.

      Scala.NotImplementedError:
      scala.NotImplementedError: No parse rules for ASTNode type: 864, text: TOK_SUBQUERY_EXPR :
      TOK_SUBQUERY_EXPR 1, 439,797, 1370
      TOK_SUBQUERY_OP 1, 439,439, 1370
      exists 1, 439,439, 1370
      TOK_QUERY 1, 441,797, 1508

      Pasting Query 35 for easy reference.
      select
      ca_state,
      cd_gender,
      cd_marital_status,
      cd_dep_count,
      count cnt1,
      min(cd_dep_count) cd_dep_count1,
      max(cd_dep_count) cd_dep_count2,
      avg(cd_dep_count) cd_dep_count3,
      cd_dep_employed_count,
      count cnt2,
      min(cd_dep_employed_count) cd_dep_employed_count1,
      max(cd_dep_employed_count) cd_dep_employed_count2,
      avg(cd_dep_employed_count) cd_dep_employed_count3,
      cd_dep_college_count,
      count cnt3,
      min(cd_dep_college_count) cd_dep_college_count1,
      max(cd_dep_college_count) cd_dep_college_count2,
      avg(cd_dep_college_count) cd_dep_college_count3
      from
      customer c
      JOIN customer_address ca ON c.c_current_addr_sk = ca.ca_address_sk
      JOIN customer_demographics ON cd_demo_sk = c.c_current_cdemo_sk
      LEFT SEMI JOIN
      (select ss_customer_sk
      from store_sales
      JOIN date_dim ON ss_sold_date_sk = d_date_sk
      where
      d_year = 2002 and
      d_qoy < 4) ss_wh1
      ON c.c_customer_sk = ss_wh1.ss_customer_sk
      where
      exists (
      select tmp.customer_sk from (
      select ws_bill_customer_sk as customer_sk
      from web_sales,date_dim
      where
      ws_sold_date_sk = d_date_sk and
      d_year = 2002 and
      d_qoy < 4
      UNION ALL
      select cs_ship_customer_sk as customer_sk
      from catalog_sales,date_dim
      where
      cs_sold_date_sk = d_date_sk and
      d_year = 2002 and
      d_qoy < 4
      ) tmp where c.c_customer_sk = tmp.customer_sk
      )
      group by ca_state,
      cd_gender,
      cd_marital_status,
      cd_dep_count,
      cd_dep_employed_count,
      cd_dep_college_count
      order by ca_state,
      cd_gender,
      cd_marital_status,
      cd_dep_count,
      cd_dep_employed_count,
      cd_dep_college_count
      limit 100;

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            hvanhovell Herman van Hövell Assign to me
            roycecil Roy Cecil
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment