Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-14484 Extensions for initial materialized views implementation
  3. HIVE-14498

Freshness period for query rewriting using materialized views

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.2.0
    • 3.0.0
    • Materialized views

    Description

      Once we have query rewriting in place (HIVE-14496), one of the main issues is data freshness in the materialized views.

      Since we will not support view maintenance at first, we could include a HiveConf property to configure a max freshness period (n timeunits). If a query comes, and the materialized view has been populated (by create, refresh, etc.) for a longer period than n, then we should not use it for rewriting the query.

      Optionally, we could print a warning for the user indicating that the materialized was not used because it was not fresh.

      Attachments

        1. HIVE-14498.01.patch
          2.48 MB
          jcamachorodriguez
        2. HIVE-14498.02.patch
          2.50 MB
          jcamachorodriguez
        3. HIVE-14498.03.patch
          2.52 MB
          jcamachorodriguez
        4. HIVE-14498.04.patch
          7.39 MB
          jcamachorodriguez
        5. HIVE-14498.05.patch
          7.40 MB
          jcamachorodriguez
        6. HIVE-14498.patch
          2.29 MB
          jcamachorodriguez

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18259 Automatic cleanup of invalidation cache for materialized views

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-18386 Create dummy materialized views registry and make it configurable

          • Major - Major loss of function.
          • Closed

          Test - A new unit, integration or system test. HIVE-18260 Add test case scenarios for materialized views invalidation cache and registry

          • Major - Major loss of function.
          • Closed
          links to

          Web Link RB link

          Activity

            People

              jcamacho Jesús Camacho Rodríguez
              jcamacho Jesús Camacho Rodríguez
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: