Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12158

Add methods to HCatClient for partition synchronization

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Patch Available
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0
    • Fix Version/s: None
    • Component/s: HCatalog
    • Labels:
    • Release Note:
      Adds updatePartitions method to HCatClient

      Description

      We have a use case where we have a list of partitions that are created as a result of a batch job (new or updated) outside of Hive and would like to synchronize them with the Hive MetaStore. We would like to use the HCatalog HCatClient but it currently does not seem to support this. However it is possible with the HiveMetaStoreClient directly. I am proposing to add the following method to HCatClient and HCatClientHMSImpl:

      A method for altering partitions. The implementation would delegate to HiveMetaStoreClient#alter_partitions. I've used "update" instead of "alter" in the name so it's consistent with the HCatClient#updateTableSchema method.

      public void updatePartitions(List<HCatPartition> partitions) throws HCatException
      

        Attachments

        1. HIVE-12158.2.patch
          11 kB
          Dave Maughan

          Activity

            People

            • Assignee:
              nahguam Dave Maughan
              Reporter:
              nahguam Dave Maughan
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated: