Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-23496

Add a flag to disable DB scan during Hive Server startup

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 2.3.7
    • None
    • HiveServer2

    Description

      At start-up, HiveServer2 will do a full DB & Table scan. For large Hive Metastores, this operation could take 10+ minutes to complete. The goal of this task is to make this “verification” optional if possible.

      Currently, Hive 2.3.7 has the following in HiveMaterializedViewsRegistry that is causing this behavior.

       

      for (String dbName : db.getAllDatabases()) {
        // TODO: We should enhance metastore API such that it returns only
        // materialized views instead of all tables
        tables.addAll(db.getAllTableObjects(dbName));
      }
      

      It seems that <= Hive 2.3.x && >= Hive 3.0 does not have this behavior.

       

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            Unassigned Unassigned Assign to me
            davidrabinowitz David Rabinowitz

            Dates

              Created:
              Updated:

              Time Tracking

              Estimated:
              Original Estimate - Not Specified
              Not Specified
              Remaining:
              Remaining Estimate - 0h
              0h
              Logged:
              Time Spent - 0.5h
              0.5h

              Slack

                Issue deployment