Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21344

CBO: Reduce compilation time in presence of materialized views

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 4.0.0
    • Fix Version/s: None
    • Component/s: Materialized views
    • Labels:
      None

      Description

      For every query, getAllValidMaterializedViews still requires a call to metastore to verify that the materializations exist, whether they are outdated or not, etc. Since this is only useful for active-active HS2 deployments, we could take a less aggressive approach and check this information only after rewriting has been triggered. In addition, we could refresh the information in the HS2 registry periodically in a background thread.

      // This is not a rebuild, we retrieve all the materializations. In turn, we do not need
      // to force the materialization contents to be up-to-date, as this is not a rebuild, and
      // we apply the user parameters (HIVE_MATERIALIZED_VIEW_REWRITING_TIME_WINDOW) instead.
      materializations = db.getAllValidMaterializedViews(getTablesUsed(basePlan), false, getTxnMgr());
      

        Attachments

          Activity

            People

            • Assignee:
              jcamachorodriguez Jesus Camacho Rodriguez
              Reporter:
              gopalv Gopal V
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: