Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18361

Extend shared work optimizer to reuse computation beyond work boundaries

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0
    • 3.0.0
    • Physical Optimizer

    Description

      Follow-up of the work in HIVE-16867.

      HIVE-16867 introduced an optimization that identifies scans on input tables that can be merged and reuses the computation that is done in the work containing those scans. In particular, we traverse both parts of the plan upstream and reuse the operators if possible.
      Currently, the optimizer will not go beyond the output edge(s) of that work. This extension removes that limitation.

      Attachments

        1. HIVE-18361.patch
          439 kB
          Jesus Camacho Rodriguez
        2. HIVE-18361.02.patch
          576 kB
          Jesus Camacho Rodriguez
        3. HIVE-18361.01.patch
          563 kB
          Jesus Camacho Rodriguez

        Issue Links

          Activity

            People

              jcamachorodriguez Jesus Camacho Rodriguez
              jcamachorodriguez Jesus Camacho Rodriguez
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: