Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-21631

Enhance metastore API to allow bulk-loading materialized views

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    Description

      Currently, every query in HS2 results in a metastore call per database to retrieve all materialized views. This causes severe performance degradation on multi-tenant clusters with thousands of databases (very similar to how the old get_function() metastore call didn't scale).

      We should add a metastore call which can retrieve all materialized view definitions at once (for all DBs) so that we don't have to make thousands of metastore calls per query.

      Attachments

        1. HIVE-21631.patch
          463 kB
          Jesus Camacho Rodriguez
        2. HIVE-21631.patch
          463 kB
          Jesus Camacho Rodriguez
        3. HIVE-21631.patch
          463 kB
          Jesus Camacho Rodriguez
        4. HIVE-21631.patch
          463 kB
          Jesus Camacho Rodriguez

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            jcamachorodriguez Jesus Camacho Rodriguez Assign to me
            ccondit Craig Condit
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 20m
              20m

              Slack

                Issue deployment