Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-3434

Batch creation of indexes for tables with a very large number of partitions

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: Indexing, Metastore
    • Labels:
      None

      Description

      When creating indexes for a table with a very large number of partitions, Hive pulls all the metadata definition from that table before starting starting the index generation. Even some of the side effects of this problem can be addressed (OOMEs, timeouts) it would be really helpful to create the indexes in batches (similar to HIVE-2050).

        Attachments

          Activity

            People

            • Assignee:
              esteban Esteban Gutierrez
              Reporter:
              esteban Esteban Gutierrez
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: