Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17969

Metastore to alter table in batches of partitions when renaming table

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0
    • Metastore
    • None

    Description

      I'm currently trying to speed up the alter table rename to feature of HMS. The recently submitted change (HIVE-9447) already helps a lot especially on Oracle HMS DBs.
      This time I intend to gain throughput independently of DB types by enabling HMS to execute this alter table command on batches of partitions (rather than 1by1)

      Attachments

        1. batched.png
          102 kB
          Ádám Szita
        2. HIVE-17969.0.patch
          6 kB
          Ádám Szita
        3. HIVE-17969.1.patch
          6 kB
          Ádám Szita
        4. HIVE-17969.2.patch
          7 kB
          Ádám Szita
        5. hive9447OptimizationOnly.png
          86 kB
          Ádám Szita
        6. original.png
          72 kB
          Ádám Szita

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            szita Ádám Szita Assign to me
            szita Ádám Szita
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment