Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20661

Dynamic partitions loading calls add partition for every partition 1-by-1

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 4.0.0
    • Fix Version/s: 4.0.0
    • Component/s: Hive
    • Labels:
      None

      Description

      Hive.loadDynamicPartitions creates partitions using a threadpool, but the update of the Metastore via the MetastoreClient is done 1-by-1. This adds unnecessary extra calls. The partitions should be created in one batch.

        Attachments

        1. HIVE-20661.01.patch
          27 kB
          László Pintér
        2. HIVE-20661.02.patch
          28 kB
          László Pintér
        3. HIVE-20661.03.patch
          31 kB
          László Pintér
        4. HIVE-20661.04.patch
          39 kB
          László Pintér
        5. HIVE-20661.05.patch
          39 kB
          László Pintér
        6. HIVE-20661.06.patch
          38 kB
          László Pintér
        7. HIVE-20661.07.patch
          38 kB
          László Pintér
        8. HIVE-20661.08.patch
          38 kB
          László Pintér
        9. HIVE-20661.09.patch
          38 kB
          László Pintér
        10. HIVE-20661.10.patch
          37 kB
          László Pintér
        11. HIVE-20661.11.patch
          37 kB
          László Pintér
        12. HIVE-20661.12.patch
          37 kB
          László Pintér

          Issue Links

            Activity

              People

              • Assignee:
                lpinter László Pintér
                Reporter:
                lpinter László Pintér
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: