Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-4762

RECOVER PARTITIONS should send new partitions in small batches to HMS

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.5.0
    • Impala 2.9.0
    • Catalog

    Description

      HMS cannot handle more than 32k partitions in one call. When adding large amount of partitions, Impala should send the new partitions in smaller batches. otherwise HMS could go OOM.

      Attachments

        Issue Links

          Activity

            People

              zamsden Zach Amsden
              jyu@cloudera.com Juan Yu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: