Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4388

Support optimized logical plan

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.10.0
    • dsl-sql
    • None

    Description

      Before converting into Beam Pipeline physical plan, logical plan should be optimized and it will be super helpful for efficiently executing Beam PTransforms pipeline. 

      Calcite has two ways for optimizing logical plan (HepPlanner and VolcanoPlanner). We can support VolcanoPlanner first and apply calcite builtin optimize rules (like 

      FilterJoinRule.FILTER_ON_JOIN) to sql query optimize plans.

      Attachments

        Issue Links

          Is contained by

          Task - A task that needs to be done. BEAM-4476 Syntax Features Unsupported

          • P3 - Non-urgent bugs, features, and improvements
          • Open
          links to

          Web Link GitHub Pull Request #5481

          Activity

            People

              vectorijk Kai Jiang
              vectorijk Kai Jiang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 6h 10m
                  6h 10m