Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3434

Batch creation of indexes for tables with a very large number of partitions

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Indexing, Metastore
    • None

    Description

      When creating indexes for a table with a very large number of partitions, Hive pulls all the metadata definition from that table before starting starting the index generation. Even some of the side effects of this problem can be addressed (OOMEs, timeouts) it would be really helpful to create the indexes in batches (similar to HIVE-2050).

      Attachments

        Activity

          People

            esteban Esteban Gutierrez
            esteban Esteban Gutierrez
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: