Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3434

Batch creation of indexes for tables with a very large number of partitions

Log workAgile BoardRank to TopRank to BottomAdd voteVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Indexing, Metastore
    • Labels:
      None

      Description

      When creating indexes for a table with a very large number of partitions, Hive pulls all the metadata definition from that table before starting starting the index generation. Even some of the side effects of this problem can be addressed (OOMEs, timeouts) it would be really helpful to create the indexes in batches (similar to HIVE-2050).

        Attachments

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              esteban Esteban Gutierrez Assign to me
              Reporter:
              esteban Esteban Gutierrez

              Dates

              • Created:
                Updated:

                Issue deployment