Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-18361

Extend shared work optimizer to reuse computation beyond work boundaries

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.0.0
    • Fix Version/s: 3.0.0
    • Component/s: Physical Optimizer
    • Labels:
    • Target Version/s:

      Description

      Follow-up of the work in HIVE-16867.

      HIVE-16867 introduced an optimization that identifies scans on input tables that can be merged and reuses the computation that is done in the work containing those scans. In particular, we traverse both parts of the plan upstream and reuse the operators if possible.
      Currently, the optimizer will not go beyond the output edge(s) of that work. This extension removes that limitation.

        Attachments

        1. HIVE-18361.patch
          439 kB
          Jesus Camacho Rodriguez
        2. HIVE-18361.01.patch
          563 kB
          Jesus Camacho Rodriguez
        3. HIVE-18361.02.patch
          576 kB
          Jesus Camacho Rodriguez

          Issue Links

            Activity

              People

              • Assignee:
                jcamachorodriguez Jesus Camacho Rodriguez
                Reporter:
                jcamachorodriguez Jesus Camacho Rodriguez
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: