Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-3855

Enable FilterSetOpTransposeRule, DrillProjectSetOpTransposeRule

    XMLWordPrintableJSON

Details

    Description

      Since the infinite planning issues (Calcite Volcano Planner: Calcite-900) reported in DRILL-3257, FilterSetOpTransposeRule, DrillProjectSetOpTransposeRule were disabled. After it can be resolved in Calcite, we have to enable these two rules to lift the performance.

      In addition, will update the plan validation in Unit test in response of the newly enabled rules.

      To cover complex cases (when some non project or filter operator is placed under the LogicalUnion operator)
      these rules should be added to main logical stage for Volcano Planner - DRILL-6371.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. DRILL-2746 Filter is not pushed into subquery past UNION ALL

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. DRILL-3130 Project can be pushed below union all / union to improve performance

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. DRILL-3257 TPCDS query 74 results in a StackOverflowError on Scale Factor 1

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. DRILL-6371 Use FilterSetOpTransposeRule, DrillProjectSetOpTransposeRule in main logical stage

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. CALCITE-1271 Enable FilterSetOpTransposeRule, AggregateUnionTransposeRule in default rule set

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. CALCITE-2223 ProjectMergeRule is infinitely matched when is applied after ProjectReduceExpressionsRule

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. CALCITE-900 ProjectSetOpTransposeRule can be improved when the input is a SetOperator with Trivial Project on top

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #1226

          Activity

            People

              vitalii Vitalii Diravka
              seanhychu Sean Hsuan-Yi Chu
              Aman Sinha Aman Sinha
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: