Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20661

Dynamic partitions loading calls add partition for every partition 1-by-1

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 4.0.0
    • 4.0.0-alpha-1
    • Hive
    • None

    Description

      Hive.loadDynamicPartitions creates partitions using a threadpool, but the update of the Metastore via the MetastoreClient is done 1-by-1. This adds unnecessary extra calls. The partitions should be created in one batch.

      Attachments

        1. HIVE-20661.01.patch
          27 kB
          László Pintér
        2. HIVE-20661.02.patch
          28 kB
          László Pintér
        3. HIVE-20661.03.patch
          31 kB
          László Pintér
        4. HIVE-20661.04.patch
          39 kB
          László Pintér
        5. HIVE-20661.05.patch
          39 kB
          László Pintér
        6. HIVE-20661.06.patch
          38 kB
          László Pintér
        7. HIVE-20661.07.patch
          38 kB
          László Pintér
        8. HIVE-20661.08.patch
          38 kB
          László Pintér
        9. HIVE-20661.09.patch
          38 kB
          László Pintér
        10. HIVE-20661.10.patch
          37 kB
          László Pintér
        11. HIVE-20661.11.patch
          37 kB
          László Pintér
        12. HIVE-20661.12.patch
          37 kB
          László Pintér

        Issue Links

          Activity

            People

              lpinter László Pintér
              lpinter László Pintér
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: