Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-6590

Disable expr rewrites and codegen for VALUES() statements

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: In Progress
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: Impala 2.8.0, Impala 2.9.0, Impala 2.10.0, Impala 2.11.0
    • Fix Version/s: None
    • Component/s: Frontend

      Description

      The analysis of statements with big VALUES clauses like INSERT INTO <tbl> VALUES is slow due to expression rewrites like constant folding. The performance of such statements has regressed since the introduction of expr rewrites and constant folding in IMPALA-1788.

      We should skip expr rewrites for VALUES altogether since it mostly provides no benefit but can have a large overhead due to evaluation of expressions in the backend (constant folding). These expressions are ultimately evaluated and materialized in the backend anyway, so there's no point in folding them during analysis.

      Similarly, there is no point in doing codegen for these exprs in the backend union node.

      Workaround

      SET ENABLE_EXPR_REWRITES=FALSE;
      SET DISABLE_CODEGEN=TRUE;
      

        Attachments

          Activity

            People

            • Assignee:
              arawat Abhishek Rawat
              Reporter:
              alex.behm Alexander Behm
            • Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

              • Created:
                Updated: