Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20661

Dynamic partitions loading calls add partition for every partition 1-by-1

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      Hive.loadDynamicPartitions creates partitions using a threadpool, but the update of the Metastore via the MetastoreClient is done 1-by-1. This adds unnecessary extra calls. The partitions should be created in one batch.

      Attachments

        1. HIVE-20661.01.patch
          27 kB
          László Pintér
        2. HIVE-20661.02.patch
          28 kB
          László Pintér
        3. HIVE-20661.03.patch
          31 kB
          László Pintér
        4. HIVE-20661.04.patch
          39 kB
          László Pintér
        5. HIVE-20661.05.patch
          39 kB
          László Pintér
        6. HIVE-20661.06.patch
          38 kB
          László Pintér
        7. HIVE-20661.07.patch
          38 kB
          László Pintér
        8. HIVE-20661.08.patch
          38 kB
          László Pintér
        9. HIVE-20661.09.patch
          38 kB
          László Pintér
        10. HIVE-20661.10.patch
          37 kB
          László Pintér
        11. HIVE-20661.11.patch
          37 kB
          László Pintér
        12. HIVE-20661.12.patch
          37 kB
          László Pintér

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            lpinter László Pintér Assign to me
            lpinter László Pintér
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment