Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-17969

Metastore to alter table in batches of partitions when renaming table

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0
    • Component/s: Metastore
    • Labels:
      None

      Description

      I'm currently trying to speed up the alter table rename to feature of HMS. The recently submitted change (HIVE-9447) already helps a lot especially on Oracle HMS DBs.
      This time I intend to gain throughput independently of DB types by enabling HMS to execute this alter table command on batches of partitions (rather than 1by1)

        Attachments

        1. batched.png
          102 kB
          Ádám Szita
        2. HIVE-17969.0.patch
          6 kB
          Ádám Szita
        3. HIVE-17969.1.patch
          6 kB
          Ádám Szita
        4. HIVE-17969.2.patch
          7 kB
          Ádám Szita
        5. hive9447OptimizationOnly.png
          86 kB
          Ádám Szita
        6. original.png
          72 kB
          Ádám Szita

          Issue Links

            Activity

              People

              • Assignee:
                szita Ádám Szita
                Reporter:
                szita Ádám Szita
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: